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ABSTRACT 

Time  series  anailysis  is  applied  to  model  human  operator  dynamics  in  pursuit 
and  coc^ensatory  tracking  modes.  The  normalized  residual  criterion  is  used  as  a 
one-step  anadytical  tool  to  enccmpass  the  processes  of  identification,  estimation., 
and  diagnostic  checking.  A pcurameter  constraining  technique  is  introduced  to  de- 
velop more  reliable  models  of  human  operator  dynamics.  The  human  operator  is  ad- 
quately  modeled  by  a second  order  dynamic  system  both  in  pursuit  and  compensatory 
tracking  modes.  In  comparing  the  a.  ta  sampling  rates,  100  msec  between  samples 
is  adequate  and  is  shown  to  provide  better  results  than  200  msec  sampling.  The 
residual  power  spectrum  and  eigenvalue  anaJLysis  shcTW  that  the  human  operator  is 
not  a generator  of  periodic  characteristics. 

I.  INTRODUCTION 

Equipment  designers  have  traditionally  called  up^  man  to  act  as  part  of 
control  systems.  The  value  of  having  a human  link  was  recognized  long  before  it 
became  possible  to  describe  systems  in  mathematical  terms.  The  htniian  operator 
could  be  asked  to  furnish  that  partic\ilar  information  transduction  needed  to  over- 
come unexpected  environmental  situations  and  compensate  for  deficiences  of  the 
equi]ment.  The  advent  of  costly  and  increasingly  complex  equipment  has  focvised 
atteation  upon  the  need  for  detailed  knowledge  of  the  human  transfer  characteris- 
tics within  its  normal  operating  range.  This  would  reduce  the  great  expense  and 
delay  attendant  upon  modification  or  redesign  of  hardware  during  the  development 
process.  The  determination  of  models  describing  human  dynamics  in  an  operating 
system  ib  a complex  and  an  inportant  problem. 

The  human  controller  h6us  several  unique  characteristics.  His  input  - output 
relationships  cannot  be  described  as  being  purely  linear,  non-linear,  jne-vari- 
able,  random,  or  discrete.  They  are  complex  combinations  of  all  of  these  charac- 
teristics [1].  The  problem  of  identification  is  further  compounded  by  the  fact 
that  the  human  operator  is  an  adaptive  controller  who  learns  frcm  experience. 
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Earlier  approaches  to  representing  the  mathematical  characteristics  of  the 
human  operator  using  classical  control  theory  (frequency  domain  analysis,  des- 
cribing functions,  and  spectral  analysis)  as  well  as  modem  control  theory  ap- 
proaches (state  variable  and  optimal  estimation  - Kalman  filtering)  have  been 
extensively  reviewed  in  the  literature  (2]-tl2]. 

For  a simple  compensatory  tracking  task  with  a controlled  element  of  unity 
gain,  ELkind  and  Porgie  [13]  obtained  the  transfer  function  of  the  human  opera- 
tor of  the  form. 


where  K = Operator  static  gain,  T.  = Lag  time  constant,  * Neiiromuscular  lag 
time  constant,  x ® Effective  time^delay. 

The  parameters  were  found  to  be  dependent  on  the  frequency  characteristic 
of  the  input  spectrum.  In  the  model  development,  the  net  phase  lag  can  be  ap- 
proximated by  an  effective  time  delay  which  is  the  sum  of  transport  delays  and 
central  nervous  system  latencies,  a time  var^'ing  component  of  delay  and  high 
frequency  lead  equalization.  Thus  the  effective  time  delay  has  a measurable 
mean  value  over  a particular  run,  but  instantaneous  values  may  vary  about  this 
mean  [27]*  In  a study  similar  to  [l3l.  Young,  et.al.  [lU]  obtained  the  follow- 
ing parameter  values  for  a rectangular  input  spectrm;  K = Uo,  x ■ 0.1  sec, 

1/T^  =0.3  sec-^,  1/T„  = 6.2  sec“I. 

1 N 

In  a variety  of  experimental  situations  and.  controlled  elements,  McRuer 
and  his  colleagues  have  shown  that  the  human  operator  follows  a Cross-over  model 
[UJ  and  has  a transfer  function  of  the  form  [12]; 


K(Tj^s+l)  e 
(T^s+l)  TjjS+l) 


where  T = lead  time  constant  and  the  other  terms  are  same  as  in  equation  (l). 

L 

In  recent  studies,  Shinners  [l]  and  Tanaka,  Goto,  and  Washizu  [l5l  have 
pioneered  the  application  of  stochastic  time  series  analysis  in  the  modeling  of 
human  operator  dynamics.  Shinners  basiceilXy  uses  the  methods  of  Box  and  Jenkins 
[i6,1T].  In  estimating  the  order  and  the  parameters  of  an  autoregressive /moving 
average  (ARMA)  model,  a three-stage  iterative  procedure  is  u&ed  for:  a)  identi- 
fication of  the  order  of  the  model,  b)  estimation  of  its  parameters,  and  c)  di- 
agnostic checking  with  the  aim  of  revealing  model  inadequacies.  In  compensatorj 
tracking  with  a controlled  element  of  unity  gain,  Shinners  [l]  has  obtained  the 
following  transfer  function  for  the  human  operator  (his  subject  C): 


G (z)  - -Q. 6? (1-0. 803  2~^)z~^ 

“ (1-0.386  z"^)  (1-0.97  z"^) 

where  x(k)  » x(k-l)  and  the  data  sampling  interval  was  0.2  seconds. 


Tanaka,  et.al.  [15]  have  used  Akaike’s  Minimum  Final  Prediction  Error  [MFPE] 
method  to  obtain  the  order  of  the  system  [18,19].  Akaike*s  information  criterion 
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(AIC)  which  is  an  alternative  method  to  obtain  the  order  of  the  system  is  based 
on  the  maximum  likelihood  principle. 

Recently,  Suen  and  Liu  [20]  have  proposed  ' jrmalized  Residual  Critericu 
(NRC)  which  seems  to  offer  several  advantages  ovt..*  other  least  square  tvpe  iden- 
tification methods.  In  comparing  against  Akaike’s  AIC  method,  -®uen  .«uid  Liu  [20] 
have  shown  that  their  method  consistently  gives  as  good  or  oexter  estimates; 
Akaike’s  criterion  sometimes  gi/es  a system  order  higher  by  one  or  two  (cf.[28] 
[29]).  0‘Neill  [21]  has  successfully  applied  the  NRC  method  of  Suen  and  Liu  to 
model  svispended  particulate  pollution  as  an  autor^5gressive  process. 

Suen  and  Liu's  NRC  method  has  the  advantage  that  it  is  a one-step  analytical 
tool  that  encompasses  the  processes  of  identification,  estimation,  and  diagnostic 
checking.  Pre-whitening  of  the  input  is  not  necessary  (cf.  Shinaers*  flD-  Also 
no  pres^imption  of  stationarity  of  the  data  time  series  is  required  for  effective 
characterization  of  the  system.  A leview  of  identification  methods  is  given  by 
Astrom  end  Eykhoff  [30].  They  also  discuss  the  relative  merits  of  parametric 
(such  as  time  series)  r^rsus  nonparametric  (such  as  impulse  resx>onae,  transfer 
function)  modeling  techniq’oes. 

The  significant  difference  between  this  work  and  previous  works,  is  the  in- 
troduction of  a theory  which  dea3.s  with  the  constraining  of  the  parameters  of  the 
estimated  time  series  models.  By  re-estimating  the  constrained  models,  more  re- 
liable and  significant  models  for  describing  human  dynamics  are  obtained.  Since 
Shinners  and  Tanaka  et.al.,  applied  time  series  analysis  to  the  human  subject  only 
in  a cempensatory  tracking  mode,  this  also  represents  the  first  time  the  technique 
has  been  extended  to  investigate  the  human  characteristics  in  both  compensatory 
and  pursuit  tracking  modes. 

II . EXPERIMENTAL  .fiSIGN  AND  DATA  ANALYSIS 

Two  subjects  we.  used  for  these  experiments.  They  will  be  referred  to  as 
subjects  FOC  and  BXK.  Prior  to  collection  of  data,  both  subjects  were  run  throu^ 
a scaled  down  set  of  experimental  practice  blocks  to  allow  them  to  approach  asymp- 
totic performance  levels. 

The  experimented  set  ’^p  is  shown  schematically  in  Figure  1.  The  humtin  opera- 
tor sp“  before  an  oscillosco  e and  manipulated  a one  degree  of  freedom  Joystick. 

The  Jo^  vick  moved  freely  with  uo  springs  or  dashpots.  The  plant  dynamics  con- 
sisted of  a simple  unity  gain.  Two  vertically  driven  horizontal  lines  were  dis- 
played on  the  oscilloscope.  The  first  lite  served  as  the  target  in  the  pursuit 
case  and  as  a zero-error  reference  line  in  the  compensatory  case.  The  other  line 
displayed  system  output  in  the  p\a*suit  c'lse  and  system  error  in  the  compensatory 
case.  The  lines  were  adjusted  in  focus  and  intensity  which  made  it  easy  for  sub- 
jects to  discriminate  between  the  two.  The  display  configuration  could  be  changed 
between  pursuit  and  compensatory  by  means  of  a twitch.  Error  was  computed  by  a 
simple  analog  circuit.  The  entire  experiment  v^s  under  the  control  of  a reel-time 
digital  computer  (General  Automation  SIC-I6/65)  with  D/A  and  A/D  channels.  The 
computer  sampled  at  20  msec  intervals  generating  the  appropriate  system  input  and 
recording  the  system  output.  The  entire  observation  period  of  66.56  secorids,  3328 
data  point  arrays  both  for  input  and  output  time  series  were  simultaneoufily  record- 
ed on  magnetic  tape. 
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SCHEMATIC  OF  EXFCIMNENT 


Figure  1:  'chcmatic  of  the  experlatental  set  up. 

The  scope  is  dual  beam;  one  channel  Is  used  to  dis- 
play input  in  pursuit  mode  and  zero  reference  in 
compensatory  mode;  the  second  channel  is  used  for 
output  in  pursuit  and  system  error  in  coopensatory 
mode.  The  error  is  cocnputed  by  a simple  analog  cir- 
cuit using  an  EAI-TR-20  analog  compurer.  The  switch 
F/C  tkilowed  the  display  to  be  changed  from  pursuit  t 
compensatory  or  vice-versa. 


Tvo  inputs  cons  1st iz^  of  su—ed  sinusoids  vere  used  vith  each  display  coc- 
figuratioD.  The  first  was  a low  frequency  range  (0.0468;  0.1465;  0.2604;  0.4557; 
0.6138  Hz)  and  the  second  was  a high  frequency  range  (0.08l3;  0.1465;  0.26o4; 
0-4557;  1.4611  Hz).  The  3\m  of  aatplitudes  of  indiridual  sinzisoids  in  the  input 
signal  was  always  equal  to  ten  and  the  coaponent  sinusoids  were  equal  in  aapli* 
tude.  These  sumed  sinusoids  generated  a ware  fora  which  was  uaxpredictahle  by 
the  subjects.  Each  operator  was  tested  with  four  experimental  variables:  pursuit 
versus  coDptnsatory  display  aode;  low  frequency  versus  high  frequency  sxa«el  sine 
waves. 

Most  of  the  statisitical  analysis  was  done  using  the  Minitab  2 statistical 
software  package  an  IBM  370  cemputer.  Graphics  azd  detailed  co^Hitatloas  were 
acccaplished  with  the  Speakeasy  coaputer  language.  Due  to  size  coos ider&t ions  of 
Minitab  2 and  the  ability  of  the  time  series  technique  to  use  fewer  samples  to 
Bodel  a process  that  is  stationary » we  could  use  fewer  observations  than  would  be 
necessary  in  Fourier  series  analysis.  Although  the  experiments  were  done  with 
20  as  sampling » the  time  series  analysis  was  done  first  using  a sampling  inter- 
val of  -0.2  sec.  To  check  the  adeqziacy  of  the  0.2  sec  sampling  interval,  the  pro- 
cedure was  repeated  using  an  interval  of  0.1  sec.  Shinners  [l]  had  found  that 
the  faster  sampling  rate  of  0.1  sec  did  not  add  any  additional  useful  infarmjttxcaa 
to  the  human  transfer  function  models.  This  point  will  be  disetzssed  later  on. 

The  first  5 seconds  of  data  were  discarded  in  both  cases  to  exclude  the  operators 
start-up  transient.  Figtire  2 shows  the  last  2C  sec  of  the  original  data  series 
of  the  two  subjects  in  compensatory  and  pursuit  tracking. 

Ill  TIME  SERIES  THEORY 

Transfer  Functions  Mcxiels  (TF) 

The  time  series  analysis  can  be  extended  to  obtain  discrete  linear  transfer 
functions  of  systems  having  an  input  x(t)  and  output  y(t).  By  x(t)  and  y(t)  we 
laean  pairs  of  observations  that  are  available  at  equispaced  intervals  of  time. 

The  behavior  of  the  dynamic  system  can  be  adequately  represented  by  the  present 
and  past  responses  and  the  cxxrrent  aru  past  inputs  of  the  system.  Ve  denote  This 
process  as  7F  vr*,a)  and  write  its  equation  as 

y(t)  5 a -hi  y(t-l)  + ♦ o ♦ 6 x(t)  ♦ ♦ B x(t-m)  v(t)  (4) 

0 1 no  ■ 

In  equation  (4)  the  parsmeters  to  be  estimated  are:  a , ...  B * 

n and  m The  time  series  v(t)  is  a random  tem  measuring  the  difference  between 
the  response  y(t)  and  the  variables  used  to  explain  the  time  series  data.  The 
parameter  neasxzres  the  mear.  output  or  the  response  of  the  process  when  there 

are  no  inputs,  i.e.,  y(t)  » a , for  t < 0. 

0 ^ 

In  precognitive  or  single  sine-wave  pursuit  tracking  mode,  the  human  opera- 
tor is  known  to  be  non-causa^  (possesses  ability  to  anticipate  or  predict  future 
input  [ 3]).  In  these  experiments,  however,  where  nixed  sinusoids  are  used,  the 
human  controller  behaves  as  a causal  system.  Ilierefore,  we  can  assume  y(t)  H 0 
prior  to  the  applied  input.  Consequently,  the  coefficient  a can  be  eliminated 
from  the  model  to  be  estimated  and  equation  (4)  becomes:  ® 

n m 

y(t)  = r a,y{t-i)  ♦ I 8 x(t-j)  ♦ v(t),  (m  ^ n)  (5) 

i*l  " J*0 
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Figure  2:  Last  20  seconds  of  the  original  data  se- 

ries at  20  ms  sampling  vith  low  frequency  suBBed  sine- 
vave  input.  In  both  pursuit  and  compensatory,  BXK  is 
slightly  better  than  FOC  in  their  tracking  ability. 
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The  autocorrelatioD  and  t;he  autocorarlance  fUoctioDS  sugfeated  by  Box  and 
Jenkins  [lo]  as  ^ools  for  aodel  estiaation  vill  not  be  considered  here  because 
these  Bethods  require  such  trial  and  error  in  the  eatlaatian  procedures.  Instead 
a technique  proposed  by  Suen  and  Liu  [20]  and  0*HellI  [21]  vhich  is  staple  and 
very  reliable  vill  be  introduced  to  estimate  the  desired  model.  This  technique 
vhich  is  a derivation  of  ordinary  least  squares  regression  analysis  is  called  the 
Somali red  Residual  Criterion  (SBC)  and  is  briefly  described  belov. 


Theory  of  Somalased  Residual  Criterion 


Equation  (3)  reduces  lo  an  autoregressive  model  AR(n)  If  x(t)  is  omitted 
from  the  model,  and  reduces  to  a moving  average  model  NA(m)  if  lags  of  y are 
omitted.  The  following  assiMpticns  vill  be  made  concemig  v(t)  for  a given  out- 
put  time  sequence  y(t),  t * [O,  T], 


( i)  E[v(t) ] « 0 


Kii)  E[v(i)v(j))  » 6^^ 


vhere  d 


ij 


1 for  i » J 
0 for  i J 


(6) 


Uii)  T n. 

The  last  assumption  in  equation  (6)  is  commonly  made  in  such  analysis  (32). 


Prom  equation  (5) 


v(t)  ■ y(t)  - la.  y(t-l) 
i«l  ^ 


t B.  x(t-j),  t - 1,  2, 
j«0  ^ 


T-.n 


(T) 


Define 

T-n  T-n 

I V (t)  ■ ||yj|2  and  Z y^(t)  » 
t»l  t«l 

Note  in  the  discussion  belov  V and  Y are  vectors  such  that 


’r(l) 

’y(i) 

V • 

y(2) 

,and  Y ■ 

y(2) 

a 

y(T-n) 

y(T-n) 

Squaring  eq  (7)  and  normalizing  by  the  total  sum  of  squares,  ve  have 

ljvl|2  lly-la.y-re  x||’ 

■ ^ e (n.a.T)  (10) 

IIIIP  Hill' 

ard  therefore 

E [||V|!2]  - EdlllP  c(n...T)]  (11) 
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Since  3r(t)»  the  data  series « is  deterministic, 
E[  imp  1 * HUP  Ele(n...T)l 
From  eq  (9)  we  hare 

El  llVjpi  - Etv^l)  ♦ y^(2)  ♦ ♦ AT-a)l. 


eq  (U)  can  be  rewritten  w: 

(12) 

(13) 


whic^  by  asst^tion  (ll)  in  eq  (6)  reduces  to 

El  imp  ] “ (T  - nlo^^  (IW) 

Substituting  eq  (1^)  in  eq  (12)  >ie  hare, 

(T-n)o  ^ 

Ele(a,B.T)l  * — (15) 

HUP 


and  by  asswption  (Hi)  eq  (15)  becawa 
To  ^ 

El- (n.B.T)  ]=  — jiYj-j-2  (l6) 

The  quantity  c(n,m,T)  depends  oa.  n,n,  and  T and  is  proportional  to  the  nor- 
malized rariance  of  the  regression  for  a giren  n and  m.  If  this  ratio  Is  mini- 
mized orer  n and  m,  then  the  data  fit  as  measured  by  the  correlation  coefficient 
p vill  be  maximized. 


Note  thst 


0 = 


imp 

ipip 


(IT) 


or 


' = ll  - c(n,in)]** 


(18) 


vhere  T,  being  a constant  for  the  data,  is  emitted  in  the  optimization  procedure, 
and  t n*si)  Is  the  minimxia  value  for  e(n,m).  This  optimization  technique  is  the 
so  called  Normalized  Hesidiial  Criterion  (XRC). 

VaT'ieF  of  e(a*m)  vere  computed  for  the  rarious  tracking  situations  and  then 
plotted  .-*lnst  different  values  of  n in  Figs-  3 and  U-  A typical  graph  (Fig. 

3A)  onsists  of  the  AR  curve  (m  « O),  and  a family  of  TP  curves.  In  Fig.  3B  the 
MA  ve,  thou^  a function  of  m,  is  superimposed  on  the  AR  and  TF  curves  to 
a ;st  in  cooparlson  among  all  threv^  models.  The  ordinate  me«^ures  the  normalized 
residual,  c(n,m),  and  this  value  is  desired  to  be  as  small  as  possible.  The  anal- 
ysis of  various  tracking  data  shoved  that  the  MA  curve  vas  the  worst.  The  AR 
curve,  though  lower  than  the  MA  curve  was  still  much  higher  than  the  family  of  TF 
curves.  Clearly  then  the  TF  model  is  to  be  prefered  and  the  question  to  ask  is 
which  TF  model  is  optimal. 

The  percentage  drop  in  e(n,m)  betv^  . the  TF  curves  is  negligible  - the  ex- 
cept?'*.*! being  the  graphs  for  the  high-freq.  inpi^t.  Figure  U,  where  the  drop  for 
m = 0,  is  considerable  compared  to  m * 1,  2,  6.  Thus  the  selected  TF  model 

'i^l  have  at  most  m * 1 since  there  is  no  apparent  explanatory  difference  contri- 
buted by  m = 2,  ...,  6.  To  add  statistical  significance  to  our  selection  of  model 
order  note  that  the  critical  test  is  whether  for  one  can  Justify  going  from 

n *lton  = 2. 

I 2 
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Since  [2o], 


T - n 

•y 

llvli^n 

n - n 

- 2 

2 l 

is  FI  02  - H'.  > T - 02^  distributed  for  iajrge  T,  we  tested  this  difference  in  going 
from  n^  = 1 to  n->  = 2.  For  example  in  Fig,  Ua,  for  m = 1 in  TF  model,  using  T » 
330,  Oj  = 1,  and  nj  = 2,  we  get  A * 29T.1.  Since  the  F - distribution  table  gives 
F^  ^(1,120)  = 0,85,  it  is  clear  that  the  data  decisively  rejects  the  hypothesis 
of  no  significant  difference  in  normalised  residual  for  n = 1 and  n = 2,  (c^. 

Astrom  and  5ykhof f t 30  ] ) . 

We,  therefore,  find  that  for  both  input  forms,  for  both  sampling  intervals, 
and  for  both  subjects  in  pursuit  as  well  as  ccmpensatory  tracking  modes  , the  op- 
timal lag  structure  n is  always  equal  to  2.  Enstrom  and  Rouse  (33)  using  discrimi- 
nant analysis  noted  that  considering  the  tradeoffs  between  accuracy  and  feasibili- 
ty for  using  a hixnan  operator  model  in  real-time  applications  a second-order  model 
was  most  appropriate.  Beyond  n = 2,  the  c(n,a)  curves  do  not  add  any  explanatory 
power  to  tne  model  selected.  The  resulting  estimated  models  of  the  operator  are 
of  the  form: 


y(t)  = 

> y(t-l^  + 

a y(t- 

-2) 

3 x(t)  ♦ v(t) 

(20) 

l 

2 

0 

for  the  low- 

-frequency 

range. 

and 

y(t)  » 

a y(t-l)  + 

a^y( t- 

-2)  > 

8 x(t)  + 8 x(t-l)  v(t) 

(21; 

1 

0 1 

for  the  high-frequency  range. 


The  parazneter  values  are  l'st;ed  in  Tables  1 and  2 under  the  column  uncons- 
trained models  for  FOC  at  IOC  ms  sampling  and  BXK  at  200  ms  sampling. 

These  tables  show,  as  Shinners  [l]  had  observed,  that  the  faster  sampling 
rate  of  100  msec  did  not  add  any  additional  information  to  the  human  transfer 
function  models.  In  both  cases,  the  model  is  of  second-order.  However,  the  va- 
lue of  the  correlation  coefficient  of  regression  for  pooled  data  from  both  sub- 
jects (equation  l8)  are  significantly  different  at  the  two  sampling  intervals: 
o(100  ms^  = 0.988  and  p(200  ms)  = 0.958.  Although  the  t-test  would  show  this 
difference  to  be  significant  at  P <0,000 5,  the  standard  t-test  is  not  valid  for 
models  with  endogenous  lags  [26].  The  estimated  standard  deviation  of  regression 
value  of  the  pooled  data  are  also  significantly  different  at  100  and  200  msec 
sampling  intervals:  al 100  msec)  = 0.39^  and  o(200  msec)  = 0.751.  Here  again, 

although  the  t-test  would  indicate  a significant  difference  at  P<O.OOC5,  it  is  not 
a valid  test.  The  mean  variance  of  the  residuals  v(t)  are  also  significantly  dif- 
ferent at  the  two  sampling  intervals:  o^^{l00  ms)  = 0.1*95  and  a^^^(200  ms)  * 1.986. 
Based  on  the  average  values  of  the  correlation  coefficients,  the  estimated  stan- 
dard deviation  of  regression  and  the  variance  of  the  residuals,  the  100  msec  sam- 
pling is  certainly  preferable  to  200  msec  sampling. 

Constraint.!  Parameter  Modeling 

In  general,  information  is  transduced  to  guide  a physical  system  through  a 
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predefiaed  course  of  action  or  sequence  of  states.  Thi^  is  accomplished  through 
a series  of  decisions,  each  intended  to  minimise  or  otherwise  constrain  some  func- 
tion of  the  perceived  error  [22].  Consequently,  a desirable  property  of  any  mod- 
el for  the  human  operator  should  be  the  ability,  in  the  steady  state,  to  track 
constant  inputs  with  sero  or  negligible  error. 

Such  a model  can  be  obtained  from  the  estimated  model  under  conditions  of 
equilibrium.  That  is,  for  sufficiently  large  t 

y(t)  = y(t-l)  = y{t-2)  - y^*  ajad  (22) 

x(t)  = x(t-l)  = 

where  y^  and  x^  are  the  steady  state  response  and  input,  respectively • 

For  the  estimated  models  eq.  (20)  and  (21),  at  physical  and  statistical  equi- 
librium the  hypothesized  form  of  eq  (20)  with  y(t)  = y % x(t)  = x and  E[v(t)]=0 
become,  ® * 


y =ay  +ay  +6* 
e I'^e  2 e 0 e 

and  for  y * x to  be  true  we  must  have 
e e 


6 = 1 - a - a 


0 1 2 

Substituting  eq  (23)  in  the  hypothesized  form  of  eq  (20),  we  get 
y(t)  - x(t)  * o [y(t-l)  - x(t)j  a [y(t-2)  - x(t)]  + v(t) 


(23) 

(2U) 


1 2 

Similarly  the  hypothesized  form  of  eq  (21)  becomes. 


y(tj  - x(t)  = a [y(t-l)  - x(t)]  + o [y(t-2)  - x(t)]  ♦ B [x(t-l)  - x(t)]  + v(t) 
* ^ ‘ (25) 


using  the  constraint. 


Again  regression  analysis  is  used  to  estimate  the  parameters  aj  ,012  * 

The  parameters  then  obtained  from  eqs  (23)  or  (26).  The  resulting  parameters 
are  also  listedT  in  Tables  1 and  2 under  the  column  constrained  models*  The  dif- 
ferences in  the  estimated  unccxistrained  and  constrained  parameters  are  small  as  is 
the  change  in  the  estimated  standard  deviation  of  regression. 

Model  Unit  Step  Response 

To  Judge  the  accuraury  and  performance  of  the  constrained  - p^^^'aneter  models 
and  the  unconstrained  - parameter  models,  they  are  each  tested  with  a unit  step 
input . 

Figures  (5)  and  (6)  show  the  step  responses  of  both  the  constrained  and  un- 
constrained models  plotted  against  time  in  seconds.  The  resultant  curves  are  re- 
vealing the  following  remarks  can  be  made  concerning  them: 
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r'  Both  models  have  time  aelays  of  about  0.2  seconds  to  0.5  seconds,  which 
is  the  time  required  for  the  response  to  reach  50$  of  the  final  value  of 
unity. 

b)  The  rise  times  of  the  constrained  models  are  shorter  than  that  the  un- 
constrained models. 

o)  The  constrained  models  have  settling  times  (the  time  to  reach  the  95$  of 
the  desired  final  valve)  between  1 and  2 seconds.  The  unconstrained  mod- 
els have  indeterminate  settling  times  since  some  never*  reach  within  5$ 
of  the  required  value  of  unity  due  to  steady  state  errors. 

d)  The  uncosntrained  models  have  varying  degrees  of  steady  state  errors, 
making  them  inconsistent  in  their  steady  state  responses.  For  example, 
the  steady  state  error  is  about  20$  in  both  samples  of  Fig.  5 and  about 
80$  in  the  top  sample  of  Fig.  6. 

The  importance  of  constraining  the  operator  models  is  obvious.  Since  the 
unconstrained  model  is  inaccurate  in  transmitting  the  known  response  of  the  unit 
step  signal,  it  cemnot  be  relied  upon  to  predict  the  sy;;tem  response  to  unknown 
inputs  to  which  the  human  may  be  subjected  to  in  practice.  This  makes  these  mod- 
els undesirable  in  describing  the  dynamics  of  the  human  controller. 

Shinners  [l]  did  not  constrain  his  operator  models  and  his  model  for  opera- 
tor C (equetion  (3))  with  unity  feedback  gives  an  error  of  15.8$  for  a step  input 
function. 

In  figixrcs  (7)  and  (8),  the  pursuit  and  compensatory  responses  are  coiiq>ared. 
These  graphs  also  reveal  interesting  dynamics.  For  the  low-frequency  range,  the 
pursuit  models  all  have  shorter  rise  time  and  shorter  time  delay  than  the  corres- 
ponding compensatory  models.  On  the  other  hand,  for  the  high-frequency  range,  the 
situation  is  reversed,  i.e.,  the  rise  time  and  the  time  delay  are  shorter  for  the 
compensatory  models.  It  Is  important  to  observe  that  the  difference  between  the 
pursuit  emd  the  compensatory  tracking  modes  lies  only  in  the  transient  stage. 

Residual  Analysis 

To  determine  whether  the  probability  assumptions  of  ordinary  leeist  squares 
have  been  mat  and  edso  to  statistically  Justify  the  selection  of  n * 2,  several 
statistical  teats  were  performed  on  the  estimated  residuals  v(t).  Basically  w** 
require  the  v(t)  to  have  a normal  distribution  and  to  be  statistically  independent. 
Since  we  are  estimating  a lag  model,  a Durb in-Wat son  test  is  inappropriate  [2l]. 
While  the  histograms  of  residuals  appeared  to  be  bell  shaped  and  normal,  we  need 
to  support  this  assessment  quantitatively.  The  sampling  distribution  of  this 
atatistic  is  approximately  the  Chi-square  distribution  with  K-1  degrees  of  free- 
dom, where  K is  the  number  of  intervals  for  a given  histogram.  For  example,  for 
the  pursuit  FOC  low-freq  at  100  msec,  ■ 0.C503.  Since  this  is  much  less  than 
2U.9958,  the  value  of  ^^0.0 5 degrees  of  freedom,  the  hypothesis 

that  the  residuals  come  from  a normal  population  cannot  be  rejected  at  the  5$ 
level  of  significance.  From  this  test  ve  conclude  that  the  residuals  are  almost 
certainly  from  a normal  distribution. 

Although  the  v(t)  values  pass  the  normality  test  well,  (our  tables  only 
go  down  to  significance  levels  of  0.005  and  the  measured  1«*  still  orders  be- 
low that  entry),  they  might  be  autoc or related.  Such  autocorrelation  would  indi- 
cate that  more  lags  should  be  used  in  the  models  of  the  human  operator.  In  this 
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sense  an  autocorrelation  test  is  more  important  than  a normality  test.  Ve  ap- 
ppUed  an  autocorrelation  test  to  the  residuals.  This  test  vas  the  standard^ 

'runs'  randomness  test  applied  .o  a sequence  [23]^  In  tni  . case*  sluce  the  v(t) 
have  zero  mean,  if  is  the  number  of  times  the  v(t)  are  less  than  0 anu  S2  the 
number  of  times  the  v(t)  are  greater  thaui  0,  then  the  number  of  runs  q of  suc- 
cessive ( + ) signs  and  (-)  signs  ir  the  v(t)  sequence  should  be  normally  dis- 
tributed vlth^mean  -and  ver lance  depending  on  s^  and  S2  - autocorrelation 
exists  in  the  v(t)  then  end  S2  vlll  maiie  q deviate  significantly  from  its  ex- 
pected value.  We  applied  the  standardized  test  statistic. 

- . [q  - (2t) 

O 

q 

t all  of  the  residuals. 

For  example « for  the  compensatory  BXK  high-freq  at  200  msec,  the  expected 
numbef  of  runs  is  153*^sj^  the  observed  nvanber  of  runs  is  s,  * lUl,  32  * 165 . This 
test  >818  found  to  he  statistically  significant  at  level  0.0000  (vithin  the  reso- 
lution and  accuracy  limits  of  Minitab  2)  indicating  a measured  lOOS  confldenoe 
that  the  residuals  are  certainly  uncorrelated.  (Details  of  8dl  of  the  statistical 
test  applied  in  this  section  can  be  found  in  [23]). 

IV  SPECTRAI.  ANALYSIS 

A stationary  stochastic  process  is  sim;ly  described  by  its  autocovariance 
function.  An  equivalent  description  is  provided  by  its  power  spectrum,  which  is 
the  Fourier  transfoim  of  the  autocovariance  function  [ITJ. 

Residual  Spectra 

In  the  anlysls  of  the  residuals , Shinners  [l]  observed  that  the  human  opera- 
tor is  a generator  of  seasonality  characteristcs.  He  defined  seasonality  as  the 
periodicity  in  the  ooservations,  i.e.,  an  observation  at  a particular  time  is  re- 
lated to  observations  frcm  previous  times  in  a periodic  maxiner.  The  seasonality 
periods  in  his  res  il  analysis  were  calculated  to  be  O.U,  1.6,  and  3.U  sec  for 
a unity  feedback  syston.  The  origin  of  this  seasonality  effect  was  not  clear. 

In  the  residual  speptra  In  Figure  9,  for  the  low-frequency  input  signal,  the 
peaks  occur  at  0 and  O.T  Hz  for  both  subjects  in  pursuit  and  ccxiq>en8atory  modes 
using  IQO  msec  sampling.  The  nearest  input  frequencies  were  O.U557  and  0.3138  Hz. 
For  the  high-frequency  input,  these  peaks  occur  at  0.2  and  1.5  Hz  In  three  out  of 
four  cases  and  at  0.5  and  1.7  Hz  for  BXF  In  pursuit  modo.  The  . t^est  input  fre- 
quency vas  1.^8  Hz. 

The  pesLks  In  residual  spectra  using  200  msec  sampling  analysis  with  low-fre- 
quency input  occur  at  1.25  Hz  in  two  cases,  at  1.35  Hz  and  at  2.2  Hz  In  one  case 
each.  These  are  outside  the  input  frequency  range.  With  the  high-frequency  input, 
the  power  spectra  ihow  peaks  at  0.7  and  2 Hz  and  in  sane  cases  t smain  hi^  even  at 
the  end  interval.  Thus  the  ^ ror  spectra  for  200  msec  sampling  augges'.s  that  this 
rate  is  not  as  capable  and  effective  as  the  100  msec  rate  in  * eproducing  the  in- 
formation content  of  the  data  series. 

Shinners  [l]  had  used  a noise  generator  with  a bandwidth  of  1.5  Hz  {our  high- 
est frequency  sinusoid  input  vas  at  1.18  Hz).  His  200  msec  aampling  analysis  vas 
probably  inadequate  as  we  have  observed  In  our  analysis.  He  ve  find  that  the 
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dominant  peak  in  residuals  is  at  zero  frequency  for  the  low-frequency  input  and 
at  about  0.2  Hz  for  the  high-frequency  input.  This  does  not  seei:  to  represent 
operator's  generated  seasonality. 

Model  Spectra 


In  any  analysis  of  a tiae  series  aodel  one  is  tenpted  to  retain  only  thenost 
significant  lags  and  external  rariables  [21].  Since  our  prinary  use  of  the  aodel 
is  for  description  of  the  operator  dynaadcs  and  to  soae  extent  for  prediction,  we 
■ust  also  weigh  the  s«  of  squares  explained  hy  each  lag  and  external  Tariahle. 

As  indicated  in  Tables  1 and  2 sane  apparently  statistically  significant  lag  coef- 
ficients (high  t values],  explain  little  of  the  total  variation  in  the  operator 
responses.  Conversely,  sone  less  significant  coefficients  (low  t values)  are  as- 
sociated with  lags  tnat  explain  a large  amount  of  variation  in  the  data  and  there- 
fore would  be  strong  predictors.  Hather  than  arbitrarily  eliminate  lags  from  the 
model,  all  the  lags  were  kept  regardless  of  the  t values  of  their  coefficients  and 
their  explained  siai  of  squares.  (The  name  "sum  of  squares'*  refers  to  the  indi- 
vidual contribution  to  the  sum  of  squares  of  regression). 

Ihe  estimated  models  (2h)  and  (23)  have  deterministic  expected  value  of  the 

form: 


y(t)  » a y(t-l)  ♦ a y(t-2)  ♦ 3 x(t)  (28) 

1 2 0 

y(t)  * o y(t-l)  + a y(t-2)  ♦ + B x(t-l)  (29) 

12^1 

where  y(t)  * £(y(t)];  E[v(t)]  * 0 by  virtue  of  the  linear  regression  assumptions 
and  a , d , 8 , 8 are  the  estimated  parameters  from  Tables  1 and  2. 

12  0 1 

Since  (23)  and  (29)  are  linear,  autonomoiis,  difference  equations,  the  sta- 
bility of  their  eqiiilibrium  determines  whether  the  predicted  operator  responses 
will  be  bounded  in  magnitude  as  t becomes  large.  The  eigenvalues  of  the  models, 
and  X satisfy  the  characteristic  polynomial: 

x2-aX-.*  *0  (30) 

I 2 


The  equilibri^JB  yit)  = 0 is  asymptotically  stable  if  and  only  if  |X.|<1,  i * 
1,2.  The  eigenvalues  are  listed  in  Trbies  3 and  k for  100  msec  sampling^models. 
If  X^  is  complex  the  term  containing  X^"^  in  the  solution  ?f  y(t)  can  be  written 


“ lAj^[Cos(2*t/T.)  + J Sin(2*t/Tj)] 

Where  is  the  characteristic  period  associated  with  and  is  given  by 
2v[tan*^  Im( X^ ) /Re( X^ ) ]*^ 


(31) 

(32) 


where  In(X^)  and  Re(X^)  are  the  imaginary  and  real  parts  of 
The  is  the  period  of  oscillation  of  the  components  of  y(t), 
are  also  tabulated  in  Tables  3 and 


respectively. 
The  values  of 
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It  is  important  to  observe  that  tht  operator  models  for  the  pursuit  and 
.'^3flipensatory  tracking  modes  in  ail  categories  produce  system  ei^^envalues  which 
have  very  large  periods  and  the  system  is  absolutely  stable. 


Discrete  Time  Series  models  can  be  Fourier  transfermed  into  the  frequency 
domain  [17*.  .hat  is. 


f ' f^ 


Hif^  X(f> 


(33) 


w^ere 


H(f) 


6 ♦ S e ♦ . . . ♦ 3 e 

,,-g  u 3— 


jDafafi 


-j2«fA 


-J2irfnA 


(3^*) 


i - a e 
1 

is  the  frequency  response  function  of  the  system.  Y(f)  and  X(f)  are  the  Foui*ier 
transforms  of  the  response  of  and  input  to  the  system,  respectively,  *^e  fre- 
quency response  function  H(f)  is  of  interest  because  it  contains  both  the  ampli- 
tude and  the  phase  - shift  information,  Vhus, 


H\f^ 


(35) 


where 


J(f)  = 

and  4(f)  , tan  "^{Irnlmf))  /Re(H(f))> 

The  frequency  response  functions,  gain  and  phase  of  the  closed  loop  system 
incorporating  a hvsaan  operator*  are  depicted  in  the  Bode  plots  in  Figure  10.  The 
Bode  plots  reveal  interesting  and  physically  plausible  dynamics  of  the  human  con- 
troller. The  gain  and  phase  characteristics  of  both  pursuit  and  compensatory 
tracking  are  quite  similar.  The  human  operator  behaves  as  a low-pass  filter.  The 
phase  drops  steadily  from  low  to  high  frequency*  i.e.,  the  output  lags  behind  the 
input . 


V.  HUMAM  OPEKATOF  TRANSFER  FUNCTION 


The  analysis  so  far  has  been  concerned  with  the  human  operator  in  the  forward 
path  of  a closed-loop  unity  feedback  system.  Equation  (33)  defines  the  closed-loop 
transfer  function  with  the  parameter  values  given  i.»  Tables  1 and  2.  Thus,  for  FOC 
in  the  pursuit  loode  with  low  frequency  input  and  100  msec  sampling. 


Hvz> 


0.188 

♦ 0.1*33z" 


(36) 


1 ♦ Gjj(z) 


where  is  the  human  opera  or  transfer  function  (as  in  equation  (3)).  There- 

fere,  ^ 


0,13ii 


i-c  ^ [ 1-0 . "^USz.  ^ ' 


(37) 


The  0-  transform  may  be  converted  into  a Laplace  transform  function  using  the 
f o i low  1 ng  re  1 at  i on : 
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Figure  10:  Frequency  response  functions  of  the  closed- 
loop  model  with  unity  feedback,  subject  BXK  in  compen- 
satory mode. 
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where  T is  the  sampliog  lnterva.1. 

From  equations  (37)  and  (38)  (T=0.1  sec), 

. , , 0.13i*(8-t-13.3) 

' ■ s(s+6.02) 


(39) 


The  human  operator  transfer  functions  in  Z - transform  and  Laplace  transform 
equivalents  are  given  in  Table  5 for  both  subjects  \ising  100  msec  sampling  analy- 
sis. T^iese  transfer  functions  are  not  in  the  normal  forms  given  in  equation  (2) 
where  an  effective  time  delay  is  included.  The  phase  lag  observed  can  be  account- 
ed for  by  a second  order  transfer  function  and  with  a zero  located  in  the  left  half 
plane  for  low-frequency  inputs  and  in  the  right-half  plane  for  high-frequency  in- 
puts. The  effective  time  delay  is  not  a measure  of  the  human  operator  reaction  time 
to  unpredictable  inputs  but  a quantity  which  models  the  phase  lag  over  the  range  of 
experimental  input  frequencies, 

Shinners  [l]  found  the  human  operator  in  compensatory  tracking  to  be  adequa- 
tely represented  by 

K(l-T,z"^) 

G.Sz)  » Y- r (‘‘0) 

" (1-T  s ) (1+T  z~^) 

Z 3 

Fot  the  sampling  interval  of  0.2  sec,  his  time  constants  had  the  following 

limits:  0<T  < 0.83,  0.39<T  <0.99,  -0.9T<T  <0.5^,  and  0.U8<K<0,65. 

1 2 3 

In  our  analysis,  (Table  5),  T2  is  always  equal  to  one  because  the  model  is 
constrained  to  have  zero  steady  state  error  for  a step  input.  T3  ranges  between 
0.287  and  0.728  with  100  msec  sampling.  Our  numerator  polynomials  are  different 
from  Shinners  and  reo’iire  at  most  one  lag  term. 

YI  CONCLUSIONS 


Time-series  modeling  is  a powerful  and  versatile  technique  in  modeling  human 
operator  dynamics.  Its  versatility  lies  in  the  fact  that  it  can  very  effectively 
model  the  operator  in  both  the  time  and  the  frequency  domain.  In  the  former  case, 
which  lies  in  the  realm  of  parametric  modeling,  the  method  is  very  parsimonious 
in  the  use  of  parameters  to  represent  the  model  structure. 

Fourier  series  analysis,  which  finds  its  greatest  utility  in  spectral  analy- 
sis (or  frequency  domain),  does  not  outperform  the  timt-series  methods.  Time- 
series  analysis  incorporating  the  stochastic  properties  of  the  data  is  a more 
useful  device  for  prediction.  Time-series  analysis  does  not  require  any  special 
type  of  input  and  can  be  used  in  a normal  operating  environment, 

A remarkable  feature  of  the  time  series  technique  is  its  ability  to  use  fewer 
observations  than  Fourier  aneCysis  in  capturing  the  necessary  dynamics  of  the  sys- 
tem. 


In  a recent  study,  Jaeger,  Agarwax,  and  Gottlieb  [2^*]  suggested  that  the  pre- 
dictor operator  performs  essentially  the  same  in  both  pursuit  and  compensatory 
tracking  modes.  Our  findings  here  are  consistent  with  those  results. 
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TABLE  5 : HUMAN  OPERATOR  TRANSFER  FUNCTIONS  (100  ms  sampling) 


Olvi*^***  « • » - ♦ **Vv.  ••  - 
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The  method  of  sampling  at  100  msec  is  found  to  be  adequate  and  effective  in 
capturing  the  information  from  the  total  observations.  The  200  msec  interval  is 
less  accurate,  especially  in  sampling  with  high-frequency  inputs,  and  is  not  re- 
commended, although  the  overall  dynamics  after  modeling  are  similar  for  the  two 
sampling  rates. 

The  Normalized  Residual  Criterion  is  a reliable  tool  for  estimation  of  the 
model  structure;  it  eliminates  the  use  of  the  auto-correlation  functions  (ACF), 
Autocovariance  function  (ACVF)  and  the  partial  correlation  function  (PCF)  [l6] 
and  it  combines  the  trial  and  error  procedures  of  identification,  estimation  and 
diagnostic  cheking  used  by  Shinners  [l]  into  a one  step  process. 

The  importance  of  constraining  the  paurameters  of  the  estimated  time  series 
models  are  stressed  in  this  study.  This  is  necessary  if  the  models  are  to  be 
accurate  in  describing  the  human  dynamics. 

The  model  spectra  and  the  eigenvalue  analysis  clearly  show  that  the  human 
operator  is  not  a generator  of  periodic  characteristics . The  human  controller's 
response  eventually  reaches  a steady  state  if  there  is  an  input  or  decays  asympto- 
tically if  the  input  is  removed. 
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ABSTRACT 


This  paper  deals  with  the  problem  of  modeling  a trained  human  operators'  track- 
ing performance  in  an  anti-aircraft  sys'iem  under  various  display  blanking  con- 
ditions. The  input  to  the  gunner  is  the  observable  tracking  error  subjected 
to  repeated  interruptions  (blanking).  A simple  and  effective  gunner  model 
was  developed  by  extending  Kou's  observer  model  [1],  which  dealt  with  the 
case  of  no  blanking.  Our  approach  is  to  model  the  effect  of  blanking  on  the 
gunner's  tracking  performance  via  modeling  the  observer  and  controller  gains. 

I.  INTRODUCTION 

One  of  the  fundamental  goals  of  the  Air  Force  In  Itc  Manned  Threat  Qualifica- 
tion Program  Is  to  evaluate  and  pr  diet  the  effectiveness  of  a manned  anti- 
aircraft artllle  :y  system.  The  main  problem  associated  with  It  Is  to  develop 
a mathematical  model (s)  for  the  gunner  so  that  analysis  and  computer  simula- 
tions of  the  closed  loop  man-machine  system  become  possible.  The  fact  that 
a trained  human  operator  performing  simple  control  tasks  has  consistent  re- 
sponse is  crucial  for  the  effort  of  human  operator  modeling. 

The  mathematical  modeling  of  a human  operator  In  a simulated  AAA  system  has 
been  studied  b>  many  Investigators  during  the  past  twenty  years.  Basically, 
the  human  operator  was  treated  as  a feedback  controller  or  compensator  In  the 
closed  loop  sysf'em.  McRuer  [2],  uting  frequency  domain  analysis,  described 
the  human  operator  with  a linear  transfer  function  and  a remnant  element. 
Klelnman  [3],  using  an  optimal  stochastic  control  formulation,  quantified  the 
human  operator  as  an  optimal  estimator  and  controller  w.r.t.  a lost  functlonnl 
and  constraints.  Rou  il],  using  a reduced  order  observer,  clu racterlzed  the 
human  operator  as  a linear  state  feedback  controller  and  Luenberger  stete  re- 
constructor, with  all  system  noises  lumped  Into  one  remnant.  A^i  t’ ase  models 
were  able  to  explain  their  laboratory  data  under  certain  speci  le«^  tracking 
conditions.  For  a discussion  of  model  validation  and  che  PID  wrAel  (simplified 
optimal  control  model),  see  Phatak  [4],  [5]. 

This  paper  develops  a blanking  model  (interrupted  ooservat^ons)  for  a h^unan 
operator  perfomung  a two-axis  tracking  task  In  a simulated  AAA  system,  ks  In 
the  previous  studies,  the  human  operator  perceives  his  tracking  error  as  a 
displayed  feedback  signal.  Ho%rever,  in  this  case,  the  display  error  signal  Is 
subjected  to  repeated  Interruptions  which  occur  at  pseudo- random  times.  The 
Interruptions  are.  In  the  real  world,  due  to  electronic /opt leal  countermeasures, 
or  weather  conditions  like  fcg  and  visibility,  etc.  Using  the  optimal  control 
model,  Klelnman  [6]  has  don«^  an  lnltl«\l  study  of  this  condition  (one  second 
blanking  without  repetition).  In  [6],  the  effects  of  blanking  on  tracking  per- 
formance were  modelled  via  Increasing  the  observation  noises.  We  apply  the 
observer  formulation,  and  model  the  effects  of  blanking  via  degrading  the  ob- 
server and  controller  gains. 

II.  THE  EXPERIMENTS  AND  THE  TRACKING  DATA 

The  general  configuration  of  the  manned  AAA  system  is  shown  In  Figure  \.  For 
a detailed  description  of  the  AAA  simulator,  see  Rrlek  [7]. 
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Figure  A.  Generel  Configuration  of  the  Blanking  Experlaenta 

Conducted  at  AMRL 


Three  trained  aubjecta  uere  aaked  to  track  a acvlng  target  (alBulated  aircraft) 
on  the  dianlay  acreen  during  an  entire  run  of  approxlMtely  40  aeconda.  The 
aubject  uaed  a rate  control  to  direct  the  gunaight  (pedeatal)  to  follov  the 
target.  The  acreen  waa  blanked  periodically  according  to  one  of  the  following 
five  bl  nking  conditiona. 

(1)  blanking  duration  1.5  aeconda,  percentage  of  tiM  blanked  25Z 

(2)  blanking  duration  3 aeconda,  percentage  of  tine  blanked  25Z 

(3)  blanking  duration  6 aeconda*  percentage  of  tiM  blanked  25Z 

(4)  blanking  duration  3 aeconda»  percentage  of  tiM  blanked  25X 

(5)  no  blanking  during  the  ire  run  (baae  line) 

There  were  four  prc-prograMed , determiniatic*  input  target  trajectoriea,  naMly, 
the  2x2  flyby«  the  4x5  flyby*  the  recoa,  and  the  weapon  delivery.  At  each  run* 
the  aubject  had  no  InforMtion  about  (a)  which  of  the  four  t rejector  lea  waa 
uaed  aa  the  driving  input » and  (b)  which  of  the  five  blanking  conditions  waa 
being  applied.  With  that  experiMntal  deaign,  the  aubject  waa  conaidered  as 
tracking  unknown  target  motion  under  paeudo-randoe  interrupt iona.  Each  of  the 
twenty  tracking  aituations  were  run  40  tiMa  each  and  the  tiM  hiatory  of  the 
tracking  errora  recorded.  The  Mana  and  atandard  devlationa  were  then  computed 
fron  the  40  replicat iona.  The  whole  experiMnt  generated  twenty  aets  of  an- 
aeeblad  cracking  data  per  aubject.  One  aubject 'a  trackin'^  data  were  aelected 
for  the  eodaling  and  aiwulation  atudy. 

SoM  obaervationa  on  the  tracking  data 

(I)  The  three  aubjecta  had  reaaonably  conaiatent  tracking  reaponaea.  The 
"patterna**  of  the  Man  tracking  errora  and  the  atandard  devlationa  %#are  very 
aieilar.  In  aoM  aituationa,  the  Mgnitudea  of  the  tracking  data  differed 
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slightly • The  differences  could  be  explained  as  due  to  a subject's  tracking 
skill  or  his  Individual  psychophysical  paraaeters. 

(2)  The  d^gratlon  of  tracking  perforvance  due  to  blanking  was  very  significant. 
The  "induced  errors"  (relative  to  no  blanking  data)  depended  on  blanking  dura* 
tlon«  percentage  of  tine  blanked,  and  local  characteristics  of  target  aotlcn. 
For  exaaple.  If  the  target  acceleration  reversed  Its  direction  irithln  a long 
blanking,  the  peak  tracking  errors  vere  significantly  such  larger  than  that 
of  the  no  blanking  case. 

III.  OBSERVER  MOKL  WITH  TIME  VARYING  GAINS 


A close  exaalnatlon  of  the  gunner's  tracking  performance  Indicates  that  the 
gunner  can  be  regarded  as  a feedback  controller.  The  feedback  available  to 
him  consists  of  the  displayed  signal  (observation)  and  the  non*vlsual  feedback 
generated  through  his  control  Interaction  with  the  dynamics  of  the  system 
(perception).  With  this  understanding,  we  assume  that  the  gunner  has  an  Inter- 
nal model  of  the  closed  loop  system  driven  by  his  observation  and  his  perception. 
It  Is  natural  to  further  assiae  that  the  gunner's  control  output  Is  coapletely 
based  on  that  Internal  model.  Also,  with  the  rate  control  In  mind.  It  is  not 
difficult  to  realize  that  the  gunner's  whole  tracking  efforts  are  basically 
designed  to  generate  a key  internal  state  variable  - the  target  velocity.  The 
gunner's  internal  model  of  target  velocity  was  considered  as  the  key  variable 
In  his  feedback  strategy.  To  quantify  the  gunner's  internal  target  velocity, 
we  asawe  that  the  internal  velocity  Is  actually  generated  via  a Luenberger 
observer  or  state  reconstructor.  The  associated  observation  or  reconstruction 
gains  are.  In  general,  time  varying.  The  gains  depend  on  tracking  conditions 
(Information  feedback),  task  difficulties  (local  trajectory  characteristics), 
tracking  skill,  and  the  gunner's  psychophysical  parameters.  Finally  we  assume 
that  the  gunner's  feedback  control  lav  is  linear  In  his  observation  and  his 
perception.  The  closed  loop  model  structure  Is  shown  in  Flgxire  B.  I ems  (1) 
to  (6)  simmarlze  the  modeling  assumptions. 


u(t) 


*b/s 


Target  trajectory 


Motor  noise  v (t,w> 


Reduced  order  observer 


^ f I Internal  model  of 
< target  motion 


y(t) 
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1 

. i /o- 

V 

TV''/ 

I Tp(t)  W 
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Figure  B.  Observer  Model  with  Time-Varying  Gains 
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Th#  modeling  «S9u«pcloos: 

(1)  Kuttan  opar«cor*8  Intarnal  Bodal  of  targac  motion  (adaptive)  g(t) 

(2)  Gun  dynaaica  and  visual  obaarvatlon  factor  (learned  by  H,0«)  -b/a»  c 


v3)  Feedback  control  lav  (linear)  -Y(t) 

(A)  Eatlaation  error  dynaalca  (reduced-order  observer)  k(t) 

(5)  Tine  delay  (neglected)  0 

(6)  Noise  structures  (%ihlte«  with  suitable  covariances)  Vn(c)»  Vy(t) 


Define  the  state  variables  of  the  closed  loop  system  as 
X(t)  • (Xj(t),  Xj(t),  Xj(t))'^  , where 

XjCt)  • y(t)  - c e(t)  • c (0.  - 0 ) — displayed  tracking  error 

Xj(t)  ■ 8^U) tru*  csrgat  valociCy 

*j(t)  ■ S(t)  ■ “ ®fU) valoclty  ••tlaation  error 

In  lieu  of  the  assui^tions  (1)  to  (6),  we  have 


0^(t)  • -b  u(t) 


u^(t)  - -Y,(t)  yp(t)  - y^(t)  0 (t) 

0(t)  - -(k(t)+«(tj  8(t)  0^(t)  + g(t)  0^(t) 


Xp(t)  - y(t)  * Vy(t,«) 
u(t)  - u^(t)  + v^(t,o)) 


The  above  equaclona  can  be  written  In  aatrlx  form  aa 
where 


X(t)  « A(t)  X(t)  F 0^(t)  + nolae  tei 


AU) 


I - bey,  c(l-bYj)  bcYj 

0 0 0 

0 g(t)  -<k(t)^+g(t)) 


Noise  terms  - 


bcv^(t*w)  - bcY^Vy(t.w) 
0 

-kbcv^(t.w) 


“ kbcv^(tgv) 


IV  THE  BLANKING  MODEL  AMD  THE  SIMULATION  STUDIES 


Only  the  elevation  case  Is  considered  here»  the  aslmuth  case  la  similar  and 
will  be  reported  elsewhere.  Note  that  c • 1 and  b -*1.34  for  the  elevation 
case.  For  slmpllcltye  m assume  that  the  observation  noise  can  be  lumped  into  the 
motor  noise  (or  simply  assume  that  there  Is  no  observation  noise).  The  co- 
variance  uf  the  motor  noise  Is  assumed  to  be  of  the  form 

E (v^(t.w)  v^(t'w))  aj(0^(t)J  Qj  (0^(t)l  (t-tM 


The  control  gains  Y(t)  and  the  observation  gains  k(t)  are  modelled  as  expontentl- 
aily  decreasing  as  the  blanking  proceeds,  and  exponentially  Increasing  as  the 
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blanking  stops.  Both  theoretic  arguaents  and  actual  identification  lead  to 
the  relation  b • Yj  %ie  assuae  that  Yj(t)  is  a constant.  Also,  g(t)  • 0, 

i.e.»  no  target  acceleration  is  perceived  by  the  gunner. 

Paraaeters  identified 

(PO)  The  base  line  paraaeters  «iere  identified  froa  the  2x2  flyby  - no  blanking 
data: 

k - 0.48,  Y,  - -2.9,  Yj  “ -0.77 
o,  - 0.0003,  a,  - 0.009,  a,  - 1.3 

(PB)  The  tiae  constants  were  identified  froa  the  2x2  flyby  - blanking  con^ 
dition  2 data: 

T (Yj.  blanking)  - 2.32  secs  t (Yj*  recovery)  - 1.92  secs 

T (k*  blanking)  " 13.0  secs  '^(k,  recovery)  - 4.0  secs 

The  above  identified  parameters  %ier%.  used  in  the  simulation  studies.  Since 
the  4x5  flyby  is  considered  to  be  aiailar  to  the  2x2  flyby,  we  only  illustrate 
siaulation  results  for  the  2x2  flyby,  the  recon,  and  the  weapon  delivery.  The 
results  under  various  blanking  conditions  are  shown  in  Figure  1 through  Figure 
8.  Figure  9 is  included  for  the  discussion  of  an  adaptive  observer  in  the 
next  section  (k  « 1.2  instead  of  0.46). 

V.  CONCLUDING  REMARKS  AND  FURTHER  RESEARCH 

Modelled  as  a linear  feedback  controller  and  a state  reconstructor,  the  gunner 
was  parameterized  by  the  control  gains  and  the  estimation  gains.  These  cime 
varying  gains  together  with  the  noise  covariances  characterized  the  guroier's 
tracking  performance.  The  time  varying  gains  directly  reflect  the  gunner's 
tracking  skill,  tracking  conditions,  and  his  own  psychophysical  parameters. 

Hence,  the  gains  were  modelled  and  identified  from  the  experiaiental  data. 

It  is  worth  noting  that  the  time  varying  estimation  gains  in  this  paper  are  not 
completely  equivalent  to  the  time^varying  gains  in  Kalman  filter.  (Note  that 

in  both  cases,  the  estimators  have  the  same  form  of  dynamics; 

* 

- (A  - K(t))  X+  obs.  data). 

The  Ricatti  equations  in  the  Kalman  filter  describe  the  propagation  of  error  co- 
variances  for  given  noise  statistics.  The  time  varying  nature  of  the  filter 
gains  is  due  to  a finite  time  of  observation.  The  noise  covariances  always 
affect  the  filter  gains  In  a fixed  manner.  If  one  treats  a human  operator  as 
a Kalman  filter  xn  his  estimation  process,  the  human  operator's  estimation 
gains  are  optimal  w.r.t.  mean-square  criterion.  However,  a constrained  Kalman 
type  estimator  can  be  designed,  see  Aoki  [8]  for  an  example  of  limited  number 
of  memory  elements.  On  the  other  hand,  a Luenberger  observer  can  be  exv^ded 
to  a stochastic  estimator,  see  Tse  (9)  for  a unifying  approach.  For  relevant 
work  on  the  implicit  adaptive  observer,  see  Nuyan  [10]. 

The  simulation  results  show  very  good  model  vs  data  matches.  Ho%iever,  as  indi- 
cated from  Figure  (1)  to  (8),  some  peak  tracking  erTors  predicted  by  the  model 
tend  to  either  overshoot  or  undershoot.  This  Is  due  to  the  non-adaptlve  internal 
model  of  target  motion  in  the  current  simulation  \g(t)  *0).  In  the  observer 
formulation,  the  "local  bandwidth"  g(t)  of  the  internal  velocity  directly  enters 
the  observation  gain  as  (k(t)  g(t)).  The  adaptive  nature  of  the  gunner's 

perception  of  target  motion  can  be  modelled  by  continuously  "updating"  the  gain. 
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In  oth«r  words,  by  «odclint  th«  gain  according  to  tha  gunnar's  parcaptlon  of 
target  accalaratlon,  tha  ovarshooca  can  ba  allminatad.  Flgura  9 showa  a typl* 
cal  slaulatlon  result  based  on  tha  Idas  of  an  adaptive  obaarvar. 
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Flfurc  1,  2x2  flyby,  no  blxnkiag. 


Figure  2,  2x2  flyby,  blanking  duration  1.5  seconds. 
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SimiARY 

Several  aodels  have  been  developed  for  describing  hueen  operator 
input-output  behavior  in  ground-to-air  target  tracking  tasks.  These 
sodels  are  intended  to  be  used  for  predicting  huean  gunner  perforeance 
and  hence  nanned  weapon  systens  effectiveness.  However,  a coaiplete 
evaluation  of  a given  systen  nust  include  a quantitative  understanding 
of  huaan  target  acquisition  control  strategies  and  resulting  perfor- 
■ance. 

This  paper  considers  the  problens  associated  with  foraulating 
and  validating  nathevatical  eodels  for  describing  and  predicting  huaan 
target  acquisition  response.  In  particular,  the  extension  of  the 
huaan  observer  aodel  to  include  the  acquisition  phase  as  well  as  Che 
tracking  segaent  is  presented.  Relationship  of  the  Observer  aodel 
structure  to  the  aore  coaplex  Standard  Optiaal  Control  aodel  foraula- 
tion  and  to  the  siapler  Transfer  Function/Noise  representation  is 
discussed.  Probleas  pertinent  to  structural  idsntif lability  and  the 
fora  of  the  paraaeterisation  are  elucidated.  A systeaatic  approach 
towards  the  identification  of  the  observer  acquisition  aodel  para- 
asters  froa  enscable  tracking  error  data  is  presented. 
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IKTRODUCTIOH 


The  purpose  of  thlc  paper  is  to  discuss  the  problems  associated  with  iden*- 
tification  of  an  observer  nodel  structure^  for  the  huaan  gunner  in  an  anti-- 
aircraft artillery  (AAA)  target-acquisition  task*  Figure  1 shows  the  block 
diagraa  for  he  AAA  tracking  task*  The  visual  display  has  a 30*  field-of-view 
(FOV)  and  provides  the  gunner  -*«ith  azinuth  (traverse  plane)  and  elevation 
pointing  errors  with  respect  to  th^  sr^^tng  target.  Experinental  data  for  the 
acquisition  and  tracking  of  target  trajectories  were  obtained  at  the  Aerospace 
Medical  Research  Laboratories  (AMRL)  for  a variety  of  initial  conditions. 
Ensead>le  tracking  error  data  for  the  azJauth  and  elevation  axes  were  obtained 
for  subsequent  use  in  identifying  the  observer  nodel  parasKters. 

EXFERIMEKTAL  DATA 

Two  trajectoiies*  a standard  2x2  flyby  and  a high-speed  flyby  called  2x2-H‘ 
were  sinulated.  Figure  2 des9ribes  the  two  target  profiles  relative  to  the 
gunsight  position.  The  target  aircraft  begin  at  the  nominal  xys  coordinates 
of  (610»  10058,  610)  meters  and  end  at  (610,  -2743,  610)  meters.  At  the  start 
of  each  nm,  the  gunsight  display  cross-hair  is  slewed  to  the  nominal  initial 
target  position.  This  corresponds  to  the  initial  condition  (0.0,  0.0)  on 
the  visual  display  shorn  in  Figure  3.  Ten  other  target  trajectories  corres- 
ponding to  the  initial  conditions  shown  in  Figure  3 %rere  simulated*  The  azi- 
muth and  elevation  angles  for  the  flyby  trajectory  may  be  computed  using 


target  Azimuth  8.^  - tan*^  ^ 

(1) 

T«.rget  Elevation  • tan 

^ /x2  + y2 

(2) 

where : 

y - 10058  - 

(3) 

D being  the  duration  * flight  in  seconds.  Note  that  D - 70  s for  the  stan- 
dard 2x2  flyby  and  <»0  ^ ror  the  2x2*H>  flyby  trajectory.  The  different  display 

initial  conditions  are  sinulated  by  offsetting  the  x and  z coordinates 

o o 

of  the  target  initial  position  while  keeping  y^  fixed  at  -10058  m*  Ei^t 

runs  per  initial  condition  were  obtained  and  the  individual  tracking  errors  in 
the  azimuth  and  elevation  axes  were  processed  to  give  ense^le  error  statis- 
tics (mean  and  standard  deviation)*  These  data  are  to  be  used  for  identifying 
the  parameters  of  the  observer  model  structure  for  the  target  acquisition 
phase  and  subsequently  for  the  tracking  segment.  The  ensemble  data  consists 
of  the  following  variables: 

t - time 

60  — mean  azimuth  error 

00  — standard  deviation  of  azimuth  error 

e . — mean  elevation  error 

o.  — standard  deviation  of  elevation  error 
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saapled  at  Intervals  of  O.U3  seconds.  Trajectory  data  for  the  11  target  pro- 
files in  the  form  of 

t:  tine 

« •• 

Target  azimuth  angle « velocity  and  acceleration 

# «• 

"*arget  elevation  angle»  velocity  and  acceleration 

was  also  recorded  every  0.03  seconds. 

Figure  3 also  shows  the  relative  apparent  initial  velocity  vector  on  the 
display  for  the  11  trajectories.  Targets  to  the  left  of  the  vertical  line  BB 
require  a counterclockwise  slew  rate  while  those  to  the  right  denand  clockwise 
sight  notion. 

OBSERVER  MODEL 

Figure  ^ shows  a block  diagram  of  the  observer  theory  model  for  the  human 
gunner.  The  input  to  the  model  is  the  displayed  error  y 

y - - c(9^  - 0^)  (3) 

where:  c « 1 for  the  elevation  axis  ... 

W 

■ cos(6  )-.  for  the  azimuth  axis, 
g EX' 

A 

The  observer  estimates  the  target  rate  according  to  the  equations 


0^  • * + ky 

(5) 

• • 

z ■ -k  c z - (kc  + c/c)ky  - k b c u^ 

(6) 

where: 

"c  ■ -^1^  - ^2  ®T 

(7) 

& • -b  u 

8 

(8) 

Kz  - 

\^Et  - 

<9) 

an 

u • u + v 
c 

(10) 

where ; 

v 4 N(0,  Q) 

(11) 

*2 

Q - cov(v)  4 + 02  8^  + 0^  . 

(12) 

In 

this  model*  k is  the  observer  gain* 

and  Y2  concrol 

lav  feedback  ga^na»  and  a^,  02  and  are  the  ncise  model  parameters. 

The  resulting  quani-statlonary  (frozen  point)  closed-loop  system  Including  the 
gunsleht  and  the  human  gunner  Is  shown  In  Figure  3.  The  equivalent  human 
gunner  describing  function  model  assuming  quasl-statlonary  conditions  Is  given 

as 
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U 

y 


(Yj^+kY^)*  + Yj) 


s + kc(l  - bY2> 


(13) 


Note  that  Y->  • r would  result  In  a "type  1 system  guaranteeing  zero  steady- 

State  track  errors  for  constant  target  angular  velocity  (l«e.g  C - constant^ 
Inputs . ^ 

The  resulting  closed- loop  system  is  deucribed  by  the  equations 


where : 


X • Fx  G0^  + Tv  , 


X « 

?!!  - -bc(Yj^  + kYj) 
- bY2 


F * c.k 
•^21 


l+ck-  bc(Yj+  kY2> 
^22  ” - 1) 

G - 

r - (-b.o)^ 


(14) 


(151 


(16) 

(17) 


and  bg  Cg  and  v are  described  earlier. 

Then  the  ensemble  statistics  can  be  cooputed  using 

• _ 

X " Fx  + GB^:  Enjei^le  Hean 

and  P ■ FF  + PF^  + GQG^:  Ensemble  Standard  De  rlatlon. 

Then 

y - 0 - 0 

^ T g 

- 0^  - (X,0)x 

gives  the  ensemble  tracking  error,  and 


^y  “ ^11 


(^8) 

(19) 


(21) 


provides  the  ensemble  error  standard  deviation.  The  observer  model  parameters 
must  he  identified  so  that  the  model  predictions  of  ensenuile  error  mean  and 
standard  deviation  match  experimental  data  according  tw  su»ie  criterion. 
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STRUCTURAL  IDEITririASILlTT 
Note  that  the  cloeed^loop  tranefcr  function 
• (•  + ck(l-bY,)  J 

^•)  « -5 5 ; 

T • + (k-*-bYj^)c«  + bk(c  Yj-CYj) 

«(s  -f  6j) 

where:  Bj^  • c(k+bYj^) 

Bj  “ bc(c\j^-  : j) 

63  - ckd-bYj)  . 

For  elevation  channel.  c*l  and  c • 0.  Thus. 

s(s  k(I-bY,)l 

^(s)  - —= . 

T e + (k  + bYj^)e  + bkY^ 


(22) 

<23) 


(24) 


(25) 


For  such  a sysCea,  only  Che  aero  and  Cwo  polea  of  cha  cranafer  function  can  bn 
uniquely  idenclfied  froa  cracking  error  data.  The  two  polea  Chat  can  be  iden- 
Clfled  are  Che  roots  of  the  characteristic  equation: 

s^  ♦ (k  + ’Yj)*  + bkYj  - 0 . (26) 

This  lapllea  tiio  aolutlona  for  k and  given  that  urn  have  identified  cwo 
Toota  -a^  and  -a^  for  the  characteristic  equation.  They  are 


Y2  cAn  be  obtained  fron  the  single  zero  at  -k(l-bY2)  k identified 

in  Eq.  (27).  thus  giving  rise  to  two  possible  solutions  for  Y2*  However,  for 
the  AAA  task,  it  is  reasonable  to  asauaw 


in  order  to  assure  **type'’  1 systee  response. 


(28) 
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OPTIMAL  COimtOL  ALTERNATIVE 

Finally*  the  feedback  gains  nsed  not  be  free  but  could  be  con- 

strained to  being  optieal  vith  respect  to  womt  standard  qtiadratic  cost  func- 
tional. Thus*  given  the  gunsight  dynamics*  the  operator's  Internal  nodel  for 
the  target  nay  be  assumed  to  be 


«T“- 


(29) 


giving  a state-space  model  for  the  gunsight/ target  trajectory  of  the  form 

^ ^ - ®g  " *2  * 

^ - 8t  - w . 


(30) 


The  operator  nay  be  assuned  to  be  minimizing  a quad**atic  cost 

t. 


oc 


♦ gu  )dt  . 


(31) 


The  optimal  control  law  may  be  obtained  by  solving  the  corresponding 
Riccati  equation  for  ^ * as 


i ^ 2 b 


(32) 


Thus  vith  ^2  * ^ * iypc  ^ system  is  guaranteed  by  the  optimal  feedback  con- 
troller as  would  be  expected. 

PARAMETER  IDENTIFICATION  APPROACH 


The  above  discussion  elucidates  the  problems  associated  vith  model  struc- 
ture ident  if  lability.  The  problem  involves  the  determination  of  the  parameters 

k ■ observer  gain 

^1*^2  “ control  gains 

6 (0)*z(0)  » mean  state  initial  conditions 

S 

a^*a2fO^  " noise  covariance  parameters 

P^^(O) *Pi^(0) *p22(0)  ■ state  covariance  initial  conditions. 

These  are  to  be  chosen  so  as  to  minimize  a cost  function 
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i(y*-y)^  ♦ X(o*-o 


]dt 


(33) 


wh«r«  y*  and  o*  ara  anaaabla  tracking  arror  Man  and  standard  daviation 
data  and  y and  ara  tha  ccrraapondlng  obaarvar  nodal  outputs. 

Thus.  cKara  ara  II  obaarvar  nodal  paranatara  that  nuat  ba  idantlflad 
according  to  tha  fit-arror  critarion  of  Cq.  (33).  This  can  laad  to  aarioua 
nunarical  problana  in  tha  application  of  tha  idantification  algorithn  (a.g. • 
nodifiad  Causa- Nav ton).  Thcrafora,  a ayatanatic  itarativa  approach  to  tha 
datamination  cf  thaae  II  paranatara  is  propoaad  using  tha  conplata  tracking 
data  including  tha  acquisition  phaaa,  as  follows; 

(1)  Idantify  (k«y^)  using  naan  tracking  arror  data  with 

(2)  Idantify  a(0)  fron  naan  acquisition  arror  data  using  (k»Y« 

tron  stap  !•  and  ?g(0)  data. 

(3)  Idantify  fron  standard  daviation  tracking  data  using 

fron  stap  1. 

(4)  Idantify  ^ ftom  standard  daviation  acquisition  data 

Using  P.  ,(0)  • at  fron  data. 

II 

(5)  Rapaat  staps  1-4  for  various  valuas  of  X in  J of  Eq.  (33). 

(6)  Datamina  functional  nodal  (if  it  nxists)  misting  acquisition  nodal 
paranatara  to  trajactory  paranatara. 

CONCLUDING  MMAMS 


Tha  abova  outlina  providas  a franswork  for  ayatanatic  idantification  of  tha 
obaarvar  nodal  paranatara.  It  is  undarstood  that  tha  saarch  ovar  would 

ba  rastrictad  in  paranatar  spaca  to  convarga  to  ona  of  tha  two  possibla  solutions 
givnn  in  Eq.  (27).  Finally,  tha  assunption  of  tha  adaquacy  of  tha  obaarvar 
nodal  for  tha  acquisition  phasa  is  inplicitly  assunad  in  this  papar.  This 
nsy  not  ba  Justifiad  if  tha  sanpla  tins  historias  for  tha  gunnar  input-output 
vsriablas  indicata  nonlinaar  or  noda  switching  bahsvior. 
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Figure*  3.  Gunslght  Display 
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Figure  4.  Obeerver  ^del  Structure 
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Figure  5.  Equivalent  Quasi -stationary  di#grasi  of  the 
AAA  Closed-Loop  Systea 
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ABSTRACT 


The  visxial  scene  is  an  important  source  of  information  for  the  manual 
approach  and  landing  task.  This  paper  deals  with  the  effect  of  this 
information  in  combination  vith  basic  display  information  on  the  approach 
performance.  In  this  context,  a pre-experiaental  model  analysis  has  been 
performed  in  terms  of  the  optimal  control  model. 

The  resulting  aircraft  approach  performance  predictions  were  compared 
vith  the  results  of  a moving  base  simulator  program. 

The  results  illustrate  that  the  model  provides  a meaningful  description 
of  the  visual  (scene)  perception  process  involved  in  the  coi^lex  (multi- 
variable, time  varying)  manual  approach  task  vith  a useful  predictive 
capability.  The  theoretical  framework  has  been  shovn  to  allov  a straight- 
forvard  investigation  of  the  complex  interaction  of  a variety  of  task 
variables . 


IHTRODUCTl. . 

The  man\ial  approach  and  landing  is  a complex  manual  control  task. 

The  process  is  time  (range)  varying  and  involves  multivariable  task 
objectives,  visxial  scene  and  display  information  and  a coo^lex  pilot's 
control  strategy.  Although  many  studies  have  dealt  vith  a variety  of 
aspects  of  this  approach  and  landing  task,  accident  statistics  indicate 
that  there  are  still  important  unansvered  questions. 

This  p^>er  sunnarizes  the  results  of  a theoretical  and  experimental 
program  addressing  the  effect  of  visual  information  on  the  manual  approach 
and  landing.  Specifically,  this  concerned  visual  scene  information  vhich 
vas  the  subject  of  a previous  stixdy  (Refs.  1 and  2)  and  basic  (head-up) 
display  information.  From  that  study  it  could  be  concluded  that  the  visual 
scene  perception  process  can  be  modelled  (described)  on  the  basis  of  linear 
perspective  geometry  and  relative  motion  cues. 


In  the  present  st\idy  the  effect  of  visxaal  scene  information  vas 
investigated  by  considering  three  (good,  poor  and  night)  visibility 
conditions.  These  three  conditions  vere  combined  vith  three  basic  head-up 
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display  (HUD)  configurations  representing  a variety  of  visual  cues.  This 
is  discussed  in  the  folloving« 

A pre-experimental  model  analysis  has  been  performed  resulting  in  a 
variety  of  aircraft  approach  performance  predictions.  These  predictions 
will  be  compared  with  the  results  of  an  experimental  program  on  a moving 
base  simulator  in  order  to  investigate  the  predictive  capability  of  the 
model . 


VISUAL  IHPORMATIOH  Hi  THE  MAHUAL  APPROACH 
Visual  approach  scene 


The  visual  scene  provides  a variety  of  perspective  geometrical  and 
relative  motion  cues.  A previous  study  (Ref.  2)  has  demontrated  that  these 
characteristics  can  be  considered  as  separate  cues  among  which  the  human 
operator  must  divide  his  attention.  A schematic  version  of  the  visual 
approach  scene  is  shown  in  figure  1.  The  cues  idiich  are  assumed  to  be 
derived  from  this  scene  are  indicated. 


The  most  important  cue  for  lateral  guidance  is  derived  from  the 
inclination  of  the  runway  sides  and/or  the  runway  centerline.  The  lateral 
deviation  is  zero  if  the  inclination  of  both  runway  sides  is  the  same 
(ta)  * and  the  inclination  of  the  centerline  is  zero  (w^  * 0),. 

^ Vesical  guidance  must  be  based  on  the  ( average  L inclination  of  the 
runway  sides  when  no  runway  end  and  no  horizon  is  visible.  In  that  case^ 
the  observer  must  know  the  nominal  inclination  (which  is  range  varying). 
However,  a better  indication  of  the  vertical  position  can  be  obtained 
when  the  depression  of  the  runway  th  eshold  with  respect  to  the  horizon 
is  visible.  Also  in  that  case,  the  observer  must  know  the  nominal  depression 
angle,  \rtiich  is,  however,  constant  during  a standard  approach  (i.e.  3 deg). 
The  final  approach  and  landing  requires  also  the  estimation  of  the  distance 
S.J  touchdown.  This  can  be  based  on  the  apparent  size  of  ground  objects,  the 
most  important  one  probably  being  the  runway  width. 

Aircraft  attitude  providing  "inner  loop"  infonaation  for  aircraft 
control  can  be  derived  from  the  relative  position  and  inclination  of 
(e.g.)  the  horizon  auid  any  aircraft  reference.  In  the  figure  the  three 
attitude  angles  are  indicated. 


In  this  paper  the  effect  of  two  visual  scene  conditions  is  considered: 
a good  visibility  condition  (GVi  i]iiq>lyizig  that  the  complete  visual  scene 
including  the  horizon  is  visible  and  a poor  visibility  condition  (FVl 
such  that  no  runway  end  and  no  horizon  can  be  discerned*  These  visual 
scene  conditions  were  combined  with  three  display  configurations  resulting 
in  six  task  configurations  considered  in  the  following  theoretical  €ind 
experimental  analysis. 
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Display  infornation 

In  a visual  approach  the  pilot  is  provided  with  not  only  the  visual 
scene  but  also  display  inforaation.  Typical  aircraft  variables  of  interest 
are  the  rate  of  descent,  airspeed,  or  groundspeed,  aircraft  position,  etc,. 
In  the  study  described  in  this  paper  three  display  configurations  vere 
involved  so  as  to  investigate  the  effect  of  various  aircraft  variables  on 
the  manual  approach  performance  and  their  interaction  vith  the  visual 
scene  information. 

Figure  2 contains  the  vis\iai  information  involved  in  the  three  head-up 
displaiy  (HUD)  configurations.  The  ”no  HUD”  configuration  (NH)  involves 
only  an  aircraft  reference  alloving  a rough  estimation  of  the  aircraft 
attitude.  The  "simple  HUD"  configuration  (SH)  is  included  to  investigate 
the  effect  of  accurate,  aircraft  attitude  information.  This  configuration 
involves  a fixed  reference  line  which  ncadnally  coincides  vith  the 
touchdown  line.  This  reference  provides  primarily  accurate  aircraft 
attitude  information  and,  to  some  extent,  approach  position  information. 

The  "advanced  HUD"  configuration  (AH)  contains,  in  addition,  the  aircraft 
velocity  vector  (earth-related),  the  runway  contoirs  including  the 
centerline  and  touchdown  line  and  the  horizon  line.  This  configuration 
was  intended  to  investigate  the  effect  of  precise  movement  information 
and  synthetic  perspective  runway  information  which  was  hypothesized  to 
become  useful  in  reduced  visibility  situations. 

The  six  task  configurations  are  sunosarized  in  table  1. 


MODEL  ANALYSIS 


Once  the  visual  scene  characteristics  are  linearly  related  to  the 
aircraft  v€uriables  of  interest  (system  states)  the  visual  cues  of  both  the 
visual  scene  and  the  HUD  can  be  described  in  terms  of  the  perception  and 
information  processing  model  (Refs.  1 and  2)  which  is  part  of  the  optimal 
control  model  (Ref.  3). 

The  approach  task  considered  consisted  of  the  control  of  a medixim 
weight  twin  engine  jet  in  the  presence  of  moderate  turbulence  (details 
are  given  in  reference  4).  A steady-state  model  analysis  was  performed 
assuming  that  the  aircraft  was  "frozen"  at  a fixed  point  of  tge  approach 
path  corresponding  with  a nosdnal  altitude  of  200  ft  for  a 3 ^approach. 

.n  addition,  a time  varying  model  analysis  was  performed  accounting  for 
t-ie  varying  turbulence  characteristics  during  a descent  and  the  time 

varyinj  (range  varying)  visual  cues. 


Model  parameters 


Model  parameters  can  be  divided  in  parameters  which  are  constant  for 
all  configurations  and  parameters  which  were  considered  as  the  remaining 
model  variables. 
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It  was  as  Slimed  that  the  pilot  adopts  a control  strategy  that 
minimizes  a performance  index  consisting  of  a weighted  sum  of  mean-squared 
path,  attitude  and  control  variables.  The  weightings  were  selected  by 
first  determining  maximum  allowable  values  (''limits'*)  of  each  variable 
and  then  setting  the  weighting  equal  to  the  square  of  the  reciprocal  of 
the  corresponding  limit.  For  details  the  reader  is  refered  to  reference  U. 

The  selection  of  the  visual  perception  parameters  is  based  on  the 
results  of  previous  studies  (Ref.  2).  The  key  model  parameters  are  the 
perceptual  thresholds  summarized  in  table  2.  Herein,  c is  the  approach 
angle  (deviation),  5 is  the  velocity  vector  deviation  from  the  touchdown 
point;  the  subscript  o means:  with  respect  to  touchdown  and  the  subscripts 
g and  it  refer  to  the  vertical  (glideslope)  and  lateral  (localizer) 
direction,  respectively.  Only  those  variables  are  given  among  which  the 
pilot  divides  his  attention  (optimally,  i.e.  minisuzing  the  afore-mentioned 
performance  index).  An  eqxial  attention  was  assumed  between  the  vertical  and 
lateral  task. 

Typical  values  were  used  for  the  remaining  model  parameters  which  have 
been  found  to  be  relatively  constant  or  insensitive  (task  independent):  a 
perceptual  time  delay  of  0.2  s,  an  overall  level  of  attention  of  -l8  dB  and 
a motor  noise  ratio  of  -25  dB. 


Steady-state  model  analysis 


Based  on  the  model  asstssptions  and  parameter  values  discuised  before 
model  predictions  could  be  made  for  the  six  task  configvurations  of  table  1 . 
The  results  consist  of  standard  deviations  of  system  variables  (path  errors 
d and  y,  forward  velocity  u,  aircraft  attitude  angles  6,  4 bind  and  control 
deflections  6 and  6 ) and  pilot  workload.  The  latter  can  be  predicted  using 
the  workload  model  discussed  in  reference  5* 

System  performance  is  summarized  in  table  3 for  tasks  Cl  to  CU.  The 
model  predicts  that  approach  performance  is  clearly  improved  when  the  sia^le 
HUD  is  prov?ded.  A substantial  improvement  is  obtained  for  the  advanced 
HUD.  This  demonstrates  clearly  the  favourable  effect  of  HUD  information  on 
the  approach  performance,  both  verticailly  and  laterally,  especially 

in  terms  of  path  deviations. 

The  effect  of  visibility  can  be  appreciated  by  comparing  configuration 
Cl  with  Ch,  The  model  predicts  that  reduced  visibility  results  in  a minor 
performance  deterioration  laterally.  The  vejrtical  performance  remains  the 
same.  This  somewhat  surprisingly  result  is  explained  by  the  predicted  pilot's 
shift  in  attention  allocation  among  the  visual  cues  (Ref.  U).  For  the  simple 
and  advanced  HUD  configurations  the  effect  of  visibility  is  negligible. 
Because  of  the  favourable  HUD  information  almost  (in  case  of  simple  HUD]  all 
(in  case  of  the  advanced  HUD)  attention  is  devoted  to  the  HUD  cues.  Conse- 
quently, a reduction  in  visibility  has  no  effect  as  long  as  the  touchdown 
point  is  visible  (or  indicated). 

Pilot  workload  predictions  (Wl.  are  also  given  in  table  3 containing 
also  the  overall  performance  index  J.  Workload  is  relatively  constant  for 
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the  four  vertical  control  configurations.  Significantly  more  effect  is 
predicted  for  the  lateral  tasks.  The  vorkload  results  for  the  combined 
tasks  indicate  that  pilot *s  vorkload  is  the  same  for  the  good  and  poor 
v:;.sibility  condition.  Furthermore,  the  effect  of  the  simple  HUD  is 
favourable  with  respect  to  not  only  the  approach  perfonnance  but  also 
the  corresponding  vorkload.  The  model  predicts  that  the  superior 
performance  of  the  advanced  HUD  corresponds  to  a somevhat  higher  level 
of  pilot  vorkload  than  corresponding  to  the  simple  HUD  configuration. 


Time  varying  analysis 


A time  varying  analysis  vas  performed  to  account  for  possibly  range 
dependent  effects  of  the  approach  task  involved  in  the  simulation  program. 

Apart  from  the  height  dependent  turbulence  (only  a varying  turbulence 
bandwidth  was  considered)  the  range  varying  viewing  characteristics  were 
included  in  the  analysis.  The  latter  is^lied  range  varying  visual  cues 
and  pilot’s  control  strategy.  For  further  details  the  reader  is  referred 
to  reference  U. 

It  vas  assumed  that  the  pilot's  allocation  of  attention  among  the 
visual  cues  vas  constant  during  the  approach.  This  "average**  allocation 
of  attention  vas  identical  to  the  optimal  allocation  of  attention  (yielding 
the  best  approach  performance)  computed  in  the  steady-state  model  analysis. 

Also  the  same  (equal)  division  of  attention  between  the  vertical  and 
lateral  task  vas  assumed. 

The  experimental  approach  task  which  will  be  discussed  in  the  next 
chapter  began  at  a range  of  58^3  m from  the  touchdown  point  (corresponding 
with  a nominal  altitude  of  1000  ft  I with  zero  intial  deviations.  The  same 
initial  condition  vas  adopted  in  the  following  model  analysis. 

The  model  results  of  configuration  Cl  are  given  in  terms  of  the  standard 
deviation  of  the  path  errors  (in  figure  3a)  and  of  the  aircraft  attitude 
angles  and  control  deflections  (in  figure  3b)  as  function  of  the  range.  It 
will  be  clear  from  the  figure  that  (linear)  path  deviations  (d  and  y)  are 
strongly  range  dependent. 

Pitch  attitude  and  elevator  activity  increase  during  the  approach.  This 
result  orginates  partly  from  the  model  assumption  that  the  pilot's  control 
strategy  is  determined  by  the  angular  glidepath  deviation.  This  implies 
that  during  the  approach  relatively  more  weight  is  placed  upon  (linear) 
glidepath  error  than  upon  pitch  attitude  and  elevator  deflection. 

The  roll  angle  and  aileron  activity  increase  somevhat  during  the  approach. 
Heading  is  slightly  decreasing.  Analogous  to  the  vertical  task  this  results 
from  the  range  varying  control  strategy. 

It  is  interesting  to  coo^are  the  results  of  the  time  varying  analysis 
with  the  steady-state  results.  Therefore,  steady-state  results  are  indicated 
in  figxire  3 corresponding  with  a nominal  altitude  of  200  ft  and  a nominal 
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altitude  of  600  ft.  Both  the  path  errors  and  the  attitude  and  control  scores 
closely  agree  for  the  steady-state  analysis  and  the  time  varying  analysis 
{with  the  exception  of  the  low  range  height  error  and  pitch  attitude  angle). 
Thus  , range  varying  effects  can  be  investigated  by  a steady-state  model 
analysis  at  different  approach  positions.  Tedious  time  varying  analysis  is 
necessary,  however,  when  dealing  with  deterministic  processes  such  as 
vindshears  (Ref.  6). 


EXPERIMENTAL  PROGRAM 

Th  objective  of  the  experimental  program  was  to  test  the  foregoing 
model  results.  In  addition,  the  experimental  results  might  allow  model 
refinements  thereby  extending  the  predi?^*ive  capability  of  the  pilot- 
aircraft  model. 


Description  of  the  experiment 

The  experiment  was  conducted  on  the  NLR  moving  base  simulator.  Details 
about  the  apparatus,  experimental  and  data  analysis  procedures  are  given  in 
reference  U.  The  flight  simulator  was  configured  to  represent  the  linear 
equations  of  motion  of  a mediiim  weight  twin  engine  Jet  transport  having  a 
weight  of  29,000  kgf. 

The  task  was  to  track  a 3^  flight  path  to  touchdown  under  VFR  conditions 
beginning  at  a range  of  58^3  m from  the  touchdown  point.  Each  run  lasted 
approximately  90  s.  The  subjects  were  instructed  to  conceive  the  task  as 
a realistic  approach  task  (given  the  simplified  circumstances ) using 
exclusively  the  outside  world  information.  Ap€irt  from  the  aforementioned 
good  and  poor  visibility  conditions  also  a night  condition  was  included. 

These  visual  scene  conditions  were  combined  with  the  aforementioned  three 
HUD  configurations  yielding  9 experimental  conditions. 

Three  experienced  pilots  participated  in  the  experiment.  In  each 
session  the  9 configurations  were  presented  to  the  pilots  in  a random  order. 
On  the  first  two  days  and  at  the  beginning  of  the  third  day  each  pilot  was 
trained  such  that  a relatively  stable  performance  level  was  reached  for 
each  condition.  All  together,  22?  training  trials  were  performed.  On  the 
third  and  fourth  day  the  subjects  ^flew"  6 formal  sessions  containing  the 
9 configurations  in  a random  order  for  data  collection.  Thus,  6 replications 
per  experimental  condition  per  pilot  were  obtained.  No  performance  was  fed 
back  during  the  formal  sessions.  Data  were  collected  in  terms  of  a variety 
of  system  variables  and  subjective  ratings  concerning  pilot  workload  and 
visual  informational  aspects. 
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Comparison  of  model  and  experimental  re*^ults 


For  an  extensive  presentation  of  all  experimental  lesxilts  the  reader 
is  referred  to  reference  U.  In  this  paper,  only  the  principal  experimental 
results  of  the  same  configurations  as  involved  in  the  model  analysis  will 
be  considered. 

The  laodel  performance  predictions  reflect  the  stochastic  nature  of  the 
approach  task.  The  statistical  measures  are  given  in  tezms  of  standard 
deviations  of  path  errors  and  aircraft  attitude  and  control  angles.  These 
random  deviations  result  from  the  system  disturbances  (turbulence),  emd 
pilot's  randomness  in  perceiving  and  processing  information  and  executing 
control  deflections.  The  corresponding  experimental  measures  for  the 
vertical  approach  task  are  the  standard  deviations  of  the  ensemble  (six 
replications  times  three  subjects).  The  ensemble  means  of  some  configuurations 
clearly  reflect  specific  control  strategy.  This  is  disctissed  in  reference  U. 
For  the  lateral  approach  task  no  systematic  ensemble  mean  has  been  found. 

So  for  this  task  the  best  overall  experimental  measure  of  raindom  pilot 
control  behavior  is  the  root-mean-squared  value  (RMS). 

T!ie  resulting  approach  performance  of  configuration  1 ( good  visibility, 
no  HUD)  is  sho%m  in  figure  U as  a function  of  the  range  The  agreement  between 
the  model  predictions  and  experimental  height  errors  is  excellent.  The  lateral 
deviations  do  not  match  as  well.  The  model  predicts  somewhat  larger  errors 
than  the  experimental  scores.  A close  match,  however,  can  easily  be  obtai  1 
when  assuming  that  somewhat  more  attention  is  devoted  to  the  latered  task 
(corresponding  with  a reduced  obs^ rvation  noise  ratio  of  2 dB) . This  is 
indicated  in  the  figure  by  the  dashed  line. 

The  aircraft  attitude  and  control  scores  are  summarized  in  tabJe  U 
as  averages  over  four  range  intervals.  The  agreement  for  the  pitch  attitude 
and  elevator  deflection  is  qxiite  good.  The  model  predicts  an  increase  in 
pitch  angle  with  decreasing  range.  This  effect  is  only  pairtly  reflected 
by  the  experimental  pitch  angles  for  this  configuration  1.  However,  the 
experimental  pitch  attitude  results  of  almost  all  other  configtirations 
did  confirm  this  model  prediction  (Ref.  5). 

The  roll  angle  scores  agree  closely.  Both  the  model  and  experimental 
results  exhibit  an  increase  in  roll  angle  with  decreasing  range.  The  model 
predicts  a heading  angle  and  aileron  activity  which  are  clearly  larger 
than  the  corresponding  experimental  scores.  This  could  be  the  result  of  a 
somewhat  different  pilot's  control  strategy. 

The  effect  of  visual  scene  information  can  be  appreciated  by  comparing 
configuration  1 and  U.  The  model  predicts  that  reduced  visibility  does  not 
result  in  a deterioration  of  the  vertical  approach  performance.  This  is 
confirmed  by  the  experimental  results  shoving  no  significant  difference 
between  both  configurations.  Laterally,  however,  the  model  predicts  that 
reduced  visibility  results  in  a (15  i)  larger  lateral  deviation.  This 
trend  is  in  accordance  with  the  experimental  results:  the  lateral  deviation 
of  configuration  U is,  on  the  average  (30  J^)  larger  than  the  one  of 
configuration  1 . 
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As  predicted  by  the  model  no  significant  effect  of  vis’ial  scene 
information  was  found  ejcperimentally  for  the  simple  and  a^^vanced  HUD 
configurations . 

The  effect  of  HUD  information  is  illustrated  in  fi^^ore  for  the  good 
visibility  condition.  The  model  predicts  that  the  simple  HUD  yields  an 
improvement  in  vertical  appro.^ch  performance.  The  experimental  results  show 
the  same  (statistically  significant)  trend  although  the  effect  is  larger 
than  predicted.  The  model  predicts  a substantial  improvement  in  vertical 
performance  when  the  advanced  HUD  is  provided.  This  corresponds  rather 
well  with  the  experimental  results  shoving  approximately  the  same  fractional 
(statistically  significant)  improvement. 

Laterally,  the  model  predicts  that  the  simple  HUD,  providing  the  pilot 
with  more  accurate  attitude  information,  results  in  reduced  lateral 
deviations.  This  result  is  not  'Obtained  experimentally.  Figure  5 shows  that 
the  simple  HUD  results  in  subs^vjitial  larger  lateral  deviatic-ns. 

One  explanation  might  be  that  th'  pilot  spent,  dtiring  the  first  part 
of  the  approach, Less  attention  to  the  lateral  task  than  assumed  in  the 
model  analysis.  This  is  illustrated  in  figure  6 shoving  the  lateral  model 
results  of  the  simple  HUD  configuration  for  both  the  orginally  asstmied 
level  of  attention  and  for  half  of  this  level.  During  the  first  part  of  the 
approach  the  data  closely  match  the  model  results  assuming  half  of  the 
original  level  of  attention.  In  the  course  of  the  approach  (below  a range 
of  3 ism)  the  level  of  attention  is  increased  resulting  in  lateral  approach 
performance  as  approximately  predicted  by  the  model. 

Pilot  workload  results  in  terms  of  normalised  subjective  ratings  and 
the  model  predictions  (larger  values  signify  higher  pilot  workload)  are 
sinnmarized  in  table  5*  The  experimental  differences  are  not  statistically 
significant  (at  the  0.05  level)  partly  tsuause  of  the  subject  variability. 
Nevertheless,  the  model  prediction  that  the  simple  HID  (C2)  corresponds 
with  a lover  workload  level  than  the  no  HUD  configuration  (Ci)  seems  to  be 
•supported  experimentally.  Furthermore,  the  model  prediction  that  the 
advanced  display  (C3)  corresponds  to  a lover  workload  level  than  the  no  HUD 
configuration  is  not  supported  experimentally.  The  model  predicts  that 
visibility  has  hardly  any  effect  on  pilot  workload  (c.f.  CJ  and  CU). 

On  the  average,  this  seems  to  be  supported  by  the  subjective  ratings. 


CONCLUDING  REMARKS 


A detailed  comparison  of  model  predictio  > and  “xperimental  results 
of  the  "good  visibility,  no  HUD"  condition  has  demonstrated  that  the 
predictive  capability  of  the  pilot -aircraft  model  describing  the  comf»lex, 
time-varying  approach  task  is  substantial. 
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The  aodel  predicts  that  reduced  visibility  has  no  effect  on  the 
vertical  approach  perfonsance  and  sone  negative  effect  on  the  lateral 
approach  performance.  This  is  supported  by  the  experimental  results. 
Furthermore,  as  predicted  by  the  model,  no  significant  effect  of  visual 
scene  information  was  found  experimentally  for  the  simple  and  advanced 
HUD  configuration. 

Th  model  predicts  that  the  simple  HUD  yields  an  improvement  in 
vertical  approach  performance.  The  experimental  results  shov  the  same 
trend  although  the  effect  is  larger  than  predicted-  The  model  predicts  a 
substantial  improvement  in  vertical  perfoxmance  when  the  advanced  HUD 
is  providea.  This  agrees  veil  vith  the  experimental  results.  Laterally, 
the  model  predicts  that  the  single  HUD  results  iu  a better  approach 
performance.  The  experirental  results,  however,  shov  larger  lateral 
deviations.  This  can  be  closely  matched  by  the  model  vhen  assuming  that 
for  this  configuration  less  attention  is  aedicated  to  the  lateral  task 
during  the  first  part  of  the  approach.  The  same  applies  to  the  advanced  HUD. 
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Table  2 Visual  thresholds  used  for  the  model  analysis 
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Table  4 A comparison  of  model  and  experimental  attitude  and  control 
scores  - Configuration  1 
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Table  5 J':>del  and  experimental  vorkload  measures 
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(I)  aircraft  reference 

(2J  REFERENCE  TO  TOOCHOOWN  POINT 

(3)  VELOOTY  VECTOR 

(4)  RUNWAY  CONTOURS 

($)  artificial  horizon 


Fig.  2 He*d-up  display  infomatior. 
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b Aircraft  attitude  and  control  angles 


Fig.  3 Approach  performance  predictions  as  a 
function  of  range  - Conf igxiration  Cl 
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^ Cooparison  of  model  and  experimental  approach 
performance  - Configurawion  Cl 


63 


orj^r?rv-i  -AGE  IS 

OF  POOR  QUALITY 


Fig.  6 Cooparison  of  model  and  experimental  lateral 
approach  performance  • Configuration  C2 
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ABSTRACT 

The  optimal  control  model  for  pllot/vehlcle  analysis  is  used 
to  explore  the  effects  of  a CGI  visual  system  and  motion  system 
dynamics  on  helicopter  hover  simulation  fidelity.  This  is 
accomplished  by  expanding  the  perceptual  aspects  of  the  model  to 
include  motion  sensing  and  by  relating  CGI  parameters  to 
information  processing  parameters  of  the  model.  Slmulatsr  fidelity 
is  examined  by  comparing  predicted  performance  and  workload  for 
flight  with  that  [predicted  for  various  simulator  configuration. 

The  results  of  the  analysis  suggest  that  simulator 
deficiencies  or  a reasonable  nature  (by  current  standards)  can 
result  in  substantial  performance  and/or  workload  infidelity.  Both 
CGI  and  motin  system  effects  are  significant  for  this  task.'  There 
is  also  a distinct  interaction  between  the  two  sources  of  pilot 
cues.  In  particular,  the  presence  of  motion  reduces  the 
sensitivity  to  CGI  limitations. 

With  respect  to  the  CGI  system,  the  most  important  parameter 
in  terms  of  its  effect  on  performance  was  display  delay.  This  was 
followed  in  order  of  importance  by  display  resolution  and 
field-of-view.  The  main  effect  associated  with  motion  system 
bandwidth  was  introduced  by  going  to  a fixed-base  only 
configuration. 

INTRODUCTION 

As  flight  control  and  management  tasks  become  more  complex  so, 
too,  do  the  simulators  used  to  investigate  these  tasks.  The 
designers  of  simulations  are  confronted  with  difficult  choices 
between  requirements  for  simulation  fidelity  and  the  needs  for 
cost-effective  methods  of  simulation.  The  latter  demands  have 
resulted  in  a trend  toward  the  use  of  digital  equipment  in 
simulation  ooth  in  modeling  the  vehicle  and  In  generating  visual 
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cues  (CGI  systems)  for  the  pilot  of  the  simulator.  These  digital 
simulations  can  have  characteristics  that  are  significantly 
different  from  those  desired.  In  particular,  unwanted  delays 
frequently  result  in  such  a simulation.  When  motion  cues  are  also 
needed,  the  problems  can  be  aggravated  further  both  by  delays  in 
generating  motion  cues  (even  with  analog  hardware)  and  by  the 
potential  lack  of  correlation  between  visual  and  motion  cues.  The 
significance  of  these  problems  has  been  amply  demonstrated  in 
recent  studies  (Gum  and  Albery  (1977),  Queijo  and  Riley  (1975))- 

In  this  paper,  the  optimal  control  model  for  pilot/vehicle 
analysis  is  used  to  investigate  the  closed-loop  consequences  of  the 
performance  limitations  associated  with  a computer  generated  image 
(CGI)  visual  system  and  a six  degree-of-freedom  motion  simulator 
(VMS)  in  a helicopter  hover  task.  The  specific  problem  addressed 
in  this  study  was  to  determine  the  potential  effects  of  CGI  and  VMS 
system  characteristics  on  closed-loop  hover  performance  and  pilot 
workload,  and  to  evaluate  these  effects  in  lignt  of 
performance/workload  levels  we  might  expect  to  see  in  the  actual 
flight  situation.  To  accomplish  this,  the  basic  OCM  is  elaborated 
to  include  sensory  perception  of  both  CGI-generated  visual  cues  and 
VMS-generated  motion  cues. 

MODEL  IMPLEMENTATION 

Our  objective  in  this  section  is  to  describe  how  this  task  is 
modelled  in  the  context  of  the  Optimal  Control  Model  (OCM)  of  the 
pilot.  Inasmuch  as  the  model  has  been  documented  extensively,  the 
discussion  ^ill  be  brief,  with  emphasis  on  those  aspects  of  the 
model  that  are  of  special  relevance  to  this  study. 

Figure  1 presents  in  block  diagramatical  form  the  structure  of 
the  OCM  as  envisioned  for  this  study.  Notice  that  the  basic  OCM  is 
immediately  distinguished  as  the  lower  portion  of  the  dashed  block 
labelled  pilot  model.  The  upper  portion  of  the  pilot  model 
displays  the  form  of  the  expanded  perceptual  model.  Observe  that 
output  signals  from  the  simulator  pass  through  dynamical  blocks 
representing  the  visual  and  vestibular  sensory  systems  of  the  human 
(such  as  inner  ear  dynamics?  to  form  two  display  vectors,  one  from 
each  modality.  The  displayed  signals  are  then  combined  via  a 
monitor.  fne  monitor  allocates  attention  tc  the  individual 
elements,  to  form  the  usual  display  vector.  The  other  blocks  in 
Figure  1 represent  the  simulator  hardware  in  a straightforward  and 
conventional  fashion.  The  main  frame  digital  computer  is  assumed 
to  generate  the  vehicle  dynamics  and  its  characteristics  are  a part 
of  that  block.  Likewise  t'.ie  display  computer  characteristics  are 
included  in  the  simulator  drive  logic  block.  In  our  study,  stick 
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dynamics  and  stick  transducer  dynamics  (such  as  computer  generated 
force  loading)  were  not  considered.  Also,  flight  instruments  were 
not  displayed  to  the  pilot  and  can  be  ignored. 


Figure  1:  Overall  Fllot/Vehicle  System 

Our  basic  modelling  approach  will  be  to  define  simulator 
hardware  and  human  sensor  dynamics,  where  appropriate,  and  to  form 
a mapping  between  simulator  and  HO  perceptual  limitaitor.s  and 
established  OCM  parameters.  To  this  end,  we  will  begin  with  a 
brief  description  of  the  task/vehicle,  followed  by  a statement  of 
the  basic  simulator  (main  frame  computer,  VMS,  and  CGI) 

characteristics  and  how  they  were  modelled.  A simple  model  for  the 
perception  of  the  visual  scene  will  then  be  discussed  along  with 
the  vestibular  models.  Finally,  a summary  of  model  parameters  and 
assumptions  will  be  presented. 

Task/Vehicle  Description 

The  pilot's  tas  is  to  hover  over  a fixed  point  at  a fixed 
altitude,  in  the  presence  of  disturbances  generated  by  air 
turbulence.  Control  is  to  be  maintained  by  relying  on 
extra-cockpit  visual  cues  obtained  from  an  out-the-window  view  and 
by  motion  cues  associated  with  helicopter  rotation  and  translation. 
Where  visual  cueing  is  provided  by  a computer  generated  image  (CGI) 
system,  and  motion  cueing  is  provided  by  a vertical  motion 
simulator  (VMS).* 

* In  spite  of  TEs  name , tKe  VMS  is  noE  restricted  to  vertical 
motion  cues;  it  is  a six  degree-of-freedom  cueing  system. 
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he  specific  helicopter  chosen  for  this  study  was  the  CH-47 
tandem  rotor  transport  helicopter.  The  linearized  and  decoupled 
equations  of  motion  for  the  helicopter,  as  well  as  the  Drygen  gust 
models  for  the  air  turbulence,  were  obtained  from  Hotfman  et  al 
(1976).  The  reader  is  referred  to  this  report  for  specific  details 
concerning  the  basic  airframe  equations. 

The  hovering  task  is  modelled  as  a disturbance  regulation 
task.  As  is  standard  procedure  for  application  of  the  OCM,  it  is 
assumed  that  the  objective  of  the  task  may  be  characterized  as 
minimization  of  the  following  cost  functional  (see  Kleinman 

(1976)): 

2 2 

J=  E f(yi/yinax^  1 

where  yigjav  ® performance  tolerance  on  the  corresponding 

var iable .“^The  values  for  yi_^^  were  chosen  to  be  5 ft  and  1 ft/sec 

al  3X 

• # • 

for  position  (x,y,z)  and  velocity  (x,y,z)  variables  and  1 apd 

.05  deg/sec  for  attitude  (^,  9,  <> ) and  attitude  rate  (^,6  , ♦) 

variables;  these  values  were  taken  from  Hoffman  et  al  (1976).  The 
weightings  on  control  rate  activity,  r^,  were  chosen  by  means  of  an 
error-control  tradeoff  analysis.  This  resulted  in  a value  of 

approximately  .1  for  the  diagonal  elements  of  the  matrix. 

It  should  be  noted  that  hover  control  of  the  unaugmented  CH-47 
is  not  an  easy  task.  The  result.*^  of  the  reference  cited  above 
suggest  that  the  task  cannot  be  performed  to  within  acceptable 
tolerances  under  IFR  conditions. 

Main -Frame  Computer 

The  vehicle  equations  of  motion  were  implemented  on  a digital 
computer,  operating  at  a nominal  update  rate  of  30  Hz.  Based  on 
results  from  the  analytic  study  by  Baron  et  al  (1978).  we  assumed 
for  simplicity  that  the  integration  routine  introduced  no 
"distortion"  in  the  continuous  vehicle  dynam:'cs  being  modelled,  and 
that  the  only  effect  of  digitization  was  the  introduction  of  a 
sample  and  hold  delay  associated  with  the  base  cycle  time  of  the 
main-frame  computer . 

CGI  Characteristics 

Table  1 summarizes  the  characteristics  used  to  define  the 
nominal  CGI  configuration.  The  nominal  f ield-of-view  specification 
is  illustrated  in  figure  2 as  screen  configuration  B.  Notice  fror 
the  table  that  no  dynamics  were  associated  with  the  CGI  system. 
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Table 


Nominal  CGI  Characteristics 


Picture  Refresh  Rate 
Display  Compute  Time 
Bf fe*v  ive  Sample  Rate/Delay 
Scen^  Content 
Field-of-View 
Display  Resoxut^on 


30  frames/s 
66  msec 
15  Hz/99  msec 
6000  edges/frame 
3 screens  across  (144^  horiz,36^  ert) 
1024  lines/frame  x 1024  pixexs/line 


Th^  graphics  computer  was  'modelled  in  the  same  fashion  as  the 
main  frame  com^^ter;  c.  sample  and  hold  delay  based  based  on  the 
refresh  rate  and  a rcap-:te  delay.  Because  the  display  computer  is 
in  series  with  the  ^ frame  computer  the  total  visual  delay  must 
include  the  main  f-  lay.  The  effective  sample  rate  is  simply 
the  slowest  componv.. . chis  path  (i.e.,  the  fastest  rate  at  which 
information  can  change'*  . This  determines  the  affective  visual  hold 
time  for  information  so  that  the  total  visual  del  \y  can  simply  be 
written  as: 


Tvis  - Tc  V(2feff)  (2) 

where  f^  is  the  reciprocal  of  the  base  cycle  time  of  the  main  frame 
computer,  Tj  is  the  display  compute  time,  and  feff  tne  effective 
sample  rate.  • 3Tc/2  seconds  of  the  total  delay  was  modelled 
as  a Pade * delay  in  the  visual  path,  while  the  rest  of  the  delay 
was  lumped  into  the  humane's  time  delay.  (Since  the  main  frame 
delay  is  common  to  both  the  VMS  and  the  CGI) 

scene  content  was  not  modelled  except  insofar  as  it  was  needed 
in  the  assumptions  for  our  visual  perception  model.  Field  of  view 
serves  to  limit  the  utility  of  the  displayed  information  and  its 
efrect  will  be  seen  when  we  discuss  the  pilot^s  perception  of  the 
/isual  scene.  Screen  resolution  limits  the  fineness  of  Jecail  the 
CGI  syst^r.  is  able  to  present.  Therefore,  we  have  modelled  it  as  a 
threshold  equal  in  value  to  the  average  vertical  and  horizontal 
angular  resolution  level.  This  threshold  is,  o course,  in  addition 
to  any  H.O.  imposed  threshold,  and  will  be  described  shortly. 
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YHS  Characteriatica 

The  nofflinal  VMS  was  aodelled  in  all  axes  as  a second^order 
dynamic  model  wltn  appropriate  position/rate/acceleration  servo 
limits.  Table  2 defines  the  nominal  parameter  values  associated 
with  each  motion  axis.  The  nominal  motion  system  did  not  include 
washoi»t  filters  as  all  predicted  motions  except  the  surge  (x) 
motio.  were  well  within  their  respective  simulator  limits.  In 
addition  to  dynamical  models  for  the  yHS  servo  system » there  is  an 
effective  motion  system  delay  due  to  the  main  frame  computer. 


Table  2:  VMS  Model  Parameters 

Lihcaikzeo  mssrc*  function:  A « ^ 

Ac 

pAJUMCtClIS: 


Axis 

jr 

r 

NOU. 

(0) 

9,4 

0.7 

50<Vs2 

IS^s 

.220 

FIT01 

(e) 

9.4 

0.7 

53<V$f 

15<Vs 

-24'^ 

26® 

YAM 

Cf) 

9.4 

0.7 

50<Vs2 

15<^s 

-2^0 

29® 

Since 

(x) 

9.4 

0.7 

16ft/$2 

2ft/s 

-2.5ft 

2.Srr 

SNAY 

(y) 

1 18.S 

0,7 

nrr/sl 

IOft/s 

-20ft 

20ft 

HCAVC 

(I)  1 

1 18.8 

0.7 

32ft/s2 

20ft/s 

-30ft 

30ft 

• MO/S 


Visual  Perception  Model 


In  contrast  to  the  relatively  well-defined  set  of  visual  cues 
provided  by  within-cockpit  instrumentation,  the  extra-coc  pit 
visual  scene  can  provide  the  pilot  with  an  exceptionally  rich 
stimulus  environment,  even  for  a relatively  simple  display. 
Attempting  to  describe  and  quantify  this  stimulus  environment  has 
been  the  object  of  many  studies  and  is  well  beyond  the  s^ope  of 
this  paper.  The  reader  is  refered  to  Brown  ( 1973) t Staples  (1970), 
and  Gibson  (1950). 

Our  initial  approach  to  modeling  the  visual  scene  was  to 
fOi.low  the  perspective  geometric  arguments  of  Vfewerinke  (1978). 
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Consequently,  eac^  object  of  importance  would  be  modeled  as  a 
series  of  line  segments,  and  incorporated  into  the  display  matrix 
C.  As  a resu^*  , each  object  can  yield  »Tiany  cues.  In  his  study  of 
the  approach  and  larding  of  a conventional  aircraft  there  were  a 
limited  number  of  well-defined  line  elements  comprising  the  visual 
scene , and  thu  the  construction  of  the  display  matrix  C was  a 
relatively  straightforward  exercise.  However  because  of  the  nature 
of  the  hover  task,  no  single  object  is  important-  Instead,  a pilot 
can  use  various  portions  of  his  visual  field,  and  any  number  of 
objects  or  parts  of  objects  to  maintain  hover  position  and 
attitude-  Furthermore,  in  our  study  no  specific  scene  was 
available . As  a consequence , we  have  assumed  that  a relatively 
"realistic"  visual  scene  is  made  available  to  the  pilot-  Since 
such  a scene  is  typically  comprised  of  thousands  (or  perhaps  tens 
of  thousands)  of  discr iminable  line  elements  (and  hence  cues),  the 
display  analysis  used  by  Wewerinke  was  not  employed. 

Our  approach,  instead,  was  to  take  a much  simplified  view  of 
visual  cue  processing,  based  on  the  following  notion.  Information 
from  cues  involve  changes  in  the  location,  and/or  orienta-ion  of 
the  various  line  elements  comprising  the  visual  scene.  These 
changes,  in  turn,  can  be  expressed  in  terms  of  changes  to  the 
angular  coordinates  associated  with  the  line  element,  two 
coordinates  per  point  For  our  we  have  taken  these  two 
coordinates  to  be  the  azimuth  and  elevation  angles  associated  with 
the  line-of-sight  (LOS)  to  a particular  line  element  endpoint. 
This  is  illustrated  in  figures  3 and  4,  which  show  how  specific 
vehicle  rotations  and  translations  result  in  changes  in  the  azimuth 
and  elevation  angles  associated  with  the  line-of-sight  to  specific 
points  in  the  visual  scene. 


Changes  in  the  LOS  angles  are  due  to  changes  in  vehicle  state 
( position  and  attitude) . Assuming  small  changes , we  ai\  use 
linearized  relations,  so  that 


^vis 


^ . A 


(3a) 

(3b) 


0 ar  c^X 

'^VIS  0- 

where  ®vis  are  the  azimuth  elevation  LOS  angles, 

and  are  tne  display  "gains'* , and  it  is  understood  that  the  abov 
relation  holds  (with  different  gains)  for  each  specific  point  in 
the  visual  scene.  We  then  assumed , for  each  vehicle  state  the 
pilot  was  trying  to  estimate,  that  he  would  cEose  one  particular 
point  in  the  visual  scene  to  provide  the  most  appropriate  visual 
cue,  and  then  share  his  attention  among  these  now  competing  cues. 
Thus , if  the  vehicle  state  is  comprised  of  three  rotational 
coordinates  and  three  translational  coordinates,  then,  in  general, 
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there  would  be  six  opeclfic  points  in  the  visual  scene  the  pilot 
would  use  for  inferring  changes  in  vehicle  states.  Notice  there  is 
a many  on  one  mapping  between  the  vehicle  state  and  each  point  in 
the  scene,  however,  rather  than  postulating  a cue  decoupling  model 
it  was  assumed  the  pilot  was  able  to  perform  the  inverse 
transformation  needea  to  infer  correct  vehicle  motion  (via  many 
observations) . 

It  is  now  appropriate  to  consider  the  fact  that  tne  pilot  *..111 
be  limited  in  his  ability  to  detect  changes  in  the  LOS  angle  cues 
available  to  him.  This  limitation  will  be  due  either  to  his  own 
inherent  sensory/perceptual  limitations,  or,  in  the  simulator 
situation,  possibly  due  to  CGI-imposed  resolution  limits.  The 
efffctive  visual  cue  threshold  will  be  the  greater  of  the  two 
thresholds  associated  with  the  pilot  and  the  display  hardware,  and 
will  ultimately  limit  the  pilot’s  ability  to  infer  vehicular  state 
changes  from  changes  in  the  visual  scene.  Naturally,  if  display 
hardware  is  not  involved  (as  in  the  actual  helicopter  environnent ) , 
then  the  effective  threshold  will  be  determined  solely  by  the 
pilot's  visual  limitations. 

Turning  first  to  the  pilot’s  visual  limitations,  «e  rtake  a 
distinction  between  angular  resolution  threshold  <0^)  and  angular 
discrimination  threshold  (ao)*  The  former  refer > to  his  visual 
acuity,  and  his  abili  y to  resolve  small  angular  differences  m the 
LOS  angle,  when  given  a visual  reference  which,  in  angular 
distance,  Is  very  close  to  the  object  being  sighted.  The  latter 
refers  to  the  pilot's  ability  to  discriminate  between  two  large 
visual  angles,  and  thus  his  ability  to  identify  a small  angular 
difference  in  the  LOS  angle,  when  given  a visual  r';iference  which, 
in  angular  distance,  is  relatively  far  from  the  object  being 
sighted. 

The  angular  resolution  threshold  (ag)  might  be  chosen  on  the 
basis  of  measured  human  visual  acuity,  which  appears  to  be  on  the 
order  of  one  ainut  c of  arc  'lowc v er , ve  chose  to 
set  it  at  a slightly  higher  level,  based  on  an  earlier  analysis  of 
the  data  obtained  from  dynamic  tracking  experimc'^vS  (Levison 
(197D): 

“r  = 0.05  deg 

The  angular  discrimination  threshold  (^p)  was  chosen  in  accordance 
with  the  Weber-Flechner  law  (Luce  and  Galanter  (1963))t  and  set  at 
a fixed  fraction  of  the  total  angle  being  viewed: 
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“d  = ®o/3C 

where  Aq  is  the  total  angle  being  viewed. 

We  now  define  the  pilot-associated  visual  threshold  as  the 
maximuffl  of  the  resolution  and  discrimination  thresholds: 

a = MAX(ag,af))  (4) 

The  overall  pilot/simulator  visual  threshold  will  be  given  by 

y > max ( a ,S ) (5) 

where  a is  the  effective  pilot  threshold  obtained  previously,  and 
the  overall  simulator  threshold  is: 

6=  ( 8h  ^v)/2 

= horizontal  CGI  resolution  threshold 
Sy  = vertical  CGI  resolution  threshold. 

The  discussion  to  this  point  has  concentrated  on  static 
‘•position-*  thresholds.  To  determine  dynamic  "velocity”  thresholds 
associated  with  visual  cueing,  one  migh^  attempt  to  assign  a value 
on  the  basis  of  past  psychophysical  motion  detection/dxscrimxnation 
experiments.  However,  a review  of  the  subject  by  Graham  (1965) 
showi  that  a wide  range  of  values  can  be  assigned,  depending  on  the 
particular  experimental  situation  and  empirical  me'“ures  used.  We 
again  chose  to  assign  a value  on  the  basis  of  lier  dynamic 
tracking  experiments. 

In  a study  of  tracking,  with  a quantized  visual  display 
(Levisot!  et  al  ( 1972)).  a good  OCM  model  match  was  obtained  by 
setting YyH  ®dual  to  the  display  quantization  level,  and  adjusting 
Yth  to  provide  the  best  fit  to  the  data.  This  resulted  in 

Tth  = 0.25  deg 

= 1-1  deg/sec 

yielding  ^atio  of  approximately  4.U.  Other  studies  have 

shown  similar  ratios  between  velocity  and  position  thresholds,  and 
thus  we  chose  for  this  study  to  specify  the  visual  velocity 
threshold  according  to: 


Y = 4 7 
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where,  if  Y is  given  in  degrees,  is  given  in  d 
Hence,  we  tie  the  rate  threshold  to  the  position  thresh 
in  turn,  depends  on  the  pilot-associated  and  display- 
resolution  limitations.  These  ideas  are  summarized  bel 
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We  are  now  in  a position  to  define  the  effective 
"informational**  thresholds,  associated  with  the  visual  cues 
available  to  the  pilot.  As  we  noted  earlier,  we  assume  the  pilot 
can  "invert"  the  appropriate  display  equations  to  obtain  an 
estimate  of  the  vehicular  attitude/position  change  from  the  visual 
cues  available  to  him.  If  we  assume  that  the  effective  visual 
threshold  applies  equally  to  the  azimuth  (^vis^  elevation 
(dyi3)  LOS  changes,  we  can  use  figures  3 and  U to  generate 
informational  threshold  functions  as  shown  in  table  3- 

This  table  relates  visual  scene  thresholds  to  (displayed) 
vehicle  state  thresholds.  To  determine  the  specific  values  for 
these  informational  thresholds,  first  assume  a nominal  hover 
altitude  (ho)  of  10  ft,  and  a nearest  eye  level  visual  target  at  a 
distance  (Iq)  of  50  ft.  Note  that  the  maximum  lateral  field  of 
view  (^FOV^  depression  angle  both  set  by  the 
screen  configuration.  Then,  minimizing  the  threshold  functions  of 
Table  3 and  solving  for  0 and  , for  each  screen  configuration 
and  display  resolution  considered,  determines  the  "best"  viewing 
locations  along  with  the  values  for  the  informational  thresholds. 
The  resulting  thresholds  are  summarized  in  Table  M. 
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Tmble  3:  Visual  Scene  Infonuclonal  Function 
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In  summary,  since  the  perceptual  dynamics  of  the  human  visual 
system  are  relatively  wide-band  i^ith  respect  to  the  system  dynamics 
we  are  modelling , we  chose  not  to  include  any  dynamic  visual 
effects.  This  allowed  us  to  implement  our  visual  perception  model 
by  simply  thresholding  the  appropriate  syst  .n  state  variables;  the 
linear/angular  positions  and  velocities  ox"  the  (simulated)  vehicle. 

Vcstibul  ir  Perception  Model 

Models  of  vestibular  motion  perception  have  been  the  subject 
of  study  for  a number  of  years , and  we  will  not  attempt  to 
summarize  this  work.  Instead,  we  refer  the  reader  to  a relatively 
recent  review  of  motion  cue  models  by  Zacharias  (1978),  in  which  a 
number  of  these  models  are  described  and  critically  reviewed. 

Figure  5 sh  ws  the  vestibular  model  in  block  diagram  form. 
The  upper  portion  models  the  semi-circular  canals  as  transducers  of 
angular  velocity,  while  the  lower  portion  models  the  otoliths  as 
transducers  of  specific  force.  Tabls  5 sumarizes  the  parameter 
values  used  in  each  of  the  vestibular  models. 
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Flgttrt  5:  Vtsttbular  Mod«l 
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T«bl*  5:  ?«r«aot*r  Valuos  for  Vostlbulor  Hodol 


To  reduce  computational  requirements  imposed  by  the  vestibular 
model I we  performed  an  analysis  of  the  power  spectrum  of  the 
vestibular  signals.  By  comparing  the  power  spectra  of  incoming 
vestibular  signals  to  that  of  their  filtered  outputs,  pass-bands 
were  identified  which  accounted  for  the  majority  of  the  correlated 
power.  Utilizing  this  information  allowed  the  elimination  of  any 
lead  or  lag  el  ' s having  break  frequencies  not  in  the 

pass-bands.  Tabl  u outlines  the  resulting  simplifications. 

Although  many  of  the  vestibular  dynamics  were  simplified  or  . 
eliminated,  the  vestibular  thresholds  given  in  table  5 were  still 
implemented. 
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Table  6:  Simplifications  to  the  Vestibular  Model 


Axis 


Simplification 


Pitch  (0) 
Roll  (4>) 
Yaw  (4,) 
Surge  (fx) 
Heave  (f^) 
Sway  (fj) 


Eliminate  canal  washout  and  adaptation  filters 
Eliminate  adaptation  filter 
Eliminate  canal  washout  and  adaptation  filters 
No  simplification 
Set  T 1 = T 2 = 0 
No  simplification 


Attention -Sharing  Model 

The  general  features  and  method  of  implementation  of  the 
attention-sharing  model  are  well  known  (see,  for  example,  Kleinman 
(1976)).  Here,  we  wish  to  describe  features  of  the  model  which  are 
specific  to  the  particular  helicopter  hover  tark  under 
consideration . 

In  our  modelling  of  the  hover  task , we  assumed  that  "full 
attention"  corresponds  to  an  overall  noise/signal  ratio  of  -20  dB, 
a level  which  is  consistent  with  the  finding  of  many  earlier  manual 
control  studies  (see,  Kleinman  et  al  (1971)).  Further  there  ’»ould 
be  an  optimum  allocation  of  attention  among  the  displayed  variables 
subject  to  several  constraints.  These  constraints  are  summarized  in 


Table  7. 

Table  7:  Monitor  Constraints 

1. 

^LAT  = ^‘lONG 

= .5 

2 . 

fs  = fs  ; ic 

equal  attention  to  a signal  and  its  rate  of 

change . 

3. 

^ves*“  ~ ^vis 

= total  axis  attention 

4. 

fTOT  = 1-0 

Notice , 

although  the 

lateral  axis  control  task  is  more  demanding 

than  the  longitudinal  axis  (see  Hoffman  (1976)),  for  the  purpose  of 
this  study  we  assumed  an  equal  split  of  attention  between  the  two 
axis.  In  addition  no  interference  is  allowed  between  modalities 
(ie.  visual  and  vestibular  signals  are  processed  in  parrallel). 
This  requires  that  within  an  axis  the  total  visual  attention  equal 
the  total  vestibular  attention.  This  last  assumption  will  clearly 
favor  the  use  of  motion  cues,  provided  they  are  useful  for  control, 
since  the  pilots  total  attention  to  the  task  is  effectively 
doubled . 
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Sumary  of  Model  Implimentation  Characteristics 
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CLOSED-LOOP  ANALYSIS  OF  CGI  AND  VMS  EFFECTS 

In  this  section,  the  optimal  control  model  with  the  expanaed 
perceptual  model  is  used  to  analyze  the  effects  of  CGI  and  VMS 
limitations  on  closed-loop  hover  performance.  The  goal  of  this 
analysis  is  to  determine  the  effects  of  CGI  and  VMS  characteristics 
on  simulator  fidelity  (more  precisely,  performance  and  workload). 
To  this  end,  a ^perfect”  or  ideal  simulator  is  defined  in  which 
there  are  no  simulation  time  delays,  no  motion  system  dynamics, 
and  an  infinite  resolution  imagery  system.  This  simulator 
configuration  corresponds  essentially  to  flight*  and  provides  a 
benchmark  against  which  to  measure  simulator  deficiencies.  In 
addition  to  the  nominal  and  perfect  motion  conditions,  results  were 
also  obtained  for  a '^no-motion**  or  fixed-base  simulator 
configuration . 

• ThrdugTi  an  oversight",  tFe  assumplldns  tHe  perTecT 

configuration  included  a f ield-of-view  constraint  relevant  to  the 
nominal  CGI  cortf iguration . This  degraded  performance  only 
slightly  from  what  would  have  been  obtained  without  the 
constraint . 
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Thus,  there  were  six  basic  simulator  configurations  to  be 
analyzed  so  as  to  evaluate  the  effects  of  the  visual  and  motion 
systems,  separately  and  together.  These  configurations  are  listed 
in  Table  8. 


Table  8.  Simulator  Configurations 


CON PI CURAT I QU 

DESCRIPTION 

P*rf«ct:  (Flight) 

No  simulator  delays,  nominal  field  of  view, 
huran  operator  thresholds,  no  VMS  dynamics 

Perfect  CCI- 
Rftalxftac  VMS 

Includes  main  frame  computer  delays  and 
VMS  platform  dynamics 

R«ali8txc  CGI- 
P«rf*ct  VMS 

Includes  mam  frame  and  display  computer 
del*.ys,  CGI  imposed  visual  thresholds,  no 
platfura  dynamics 

Rtalistic  CGI-  1 

Rttalxsric  VMS  1 

1 

1 Includes  all  simulator  nominal 
characteristics  (see  Table  S.l) 

Perfect  CGI-  j 

Fxxttd  1 

1 

Includes  mam  frame  computer  delays  in 
visual  cues,  no  motion  eves 

Raalxstxc  CGI- 
Fxx«d 

Includes  CGI  limitations,  no  motion  cues 

Results  a’^d  Discussion 

The  effects  of  CGI  and  motion  system  characteristics  will  be 
examined  largely  in  terms  of  relative  performance  in  the  hovering 
task.  For  each  axis,  relative  performance  is  defined  as 


Performance  (in  %)  s 100  x ( J-JflT^/»^FLT 


where  J is  the  value  of  the  cost  functional  of  Eq.  1 and  JpLT 
corresponds  to  the  value  of  J obtained  for  flighc  or  the  "perfect** 
simulator.  Thus,  relative  performance  is  a normalized  metric  of 
performance  that  .leasures  the  percent  deviation  from  "flight** 
performance  introduced  by  the  simulator  character istics . In  this 
sense,  relative  performance  is  a measure  of  simulator  fidelity. 

The  results  will  be  presented  in  terms  of  J (rather  than 
individ  '3l  error  and  control  scores)  because  this  quantity  is  a 
scalar  met*  c of  overall  performance  and,  therefore,  provides  a 
concise  description  of  the  simulator  effects.  In  addition,  Hess 
(1977)  has  shown  that  the  value  of  J may  be  correlated  with 
vehicle  flying  qualities,  so  increases  in  J owing  to  simulator 
deficiencies  may  be  related  to  degraded  flying  qualities  for  the 
simulator.  Nonetheless,  individual  error  and  control  scores  may 
also  be  of  interest  an  ' these  are  presented  later  in  table  9 for 
the  six  simulator  conf  ii^urations . 
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Table  10  summarizes  the  optimal  attention  split  found  for  the 
nominal  fixed  and  moving  base  simulator  configurations.  As 
discussed  in  Kleinman  (1976),  the  attention  paid  to  a variable 
indicates  its  relative  importance  to  the  task.  Table  10  shows  that 
pitch  and  pitch  rate  information  is  the  single  most  important 
visually  obtained  variable  for  the  longitudinal  axis,  while  roll 
and  roll  rate  are  most  useful  for  lateral  control.  Of  the 
vestibular  cues,  pitch,  pitch  rate,  and  z-axis  specific  force  are 
all  important  for  longitudinal  control,  while  y-axis  specific  force 
is  the  most  useful  cue  for  lateral  control. 
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Table  9:  RMS  Performance  Scores 


Table  10:  Attention  Allocation  Nominal  Configurations 
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Figure  6:  Relative  Ferforicance  V9.  Simulator  Configurationa 


Overall  CGI  ancJ  Hotion  Syateai  E^Tects 

Figure,  6 pr  iaents  the  aiodel  perforiaance  predictions  for  the 
five  simulator  configurations,  relative  to  that  eKpected  from  the 
"perfect"  simulator  (which,  by  definition,  has  a relative 
performance  of  ^ero>*  With  respect  to  longitudinal  performar -;e , 
it  can  be  seen  that  the  effect  of  the  CGI  is  much  more  significant 
( 35%)  than  that  of  the  motion  system  ( 10%).  Indeed,  performance 
is  better  with  a perfect  CGI  and  no  motion  than  with  perfect  motio*' 
and  a realistic  CGI.  However,  motion  is  "till  Important 
particularly  if  the  realistic  CGI  deficiencies  ^re  accounted  for* 
Thl.*  is  shown  by  prediction  of  approKimatel y twice  the  relat  ve 
performance  for  ^.he  realistic  CGI-fixed  base  configuration  as  for 
the  realistic  CGI-realistic  VMS  configuration . 
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The  results  for  the  lateral  control  task  are  similar  to  those 
for  the  longitudinal  task,  but  motion  is  even  more  important.  In 
this  case,  having  a perfect  CGI  doe.,  not  compensate  for  lack  of 
motion,  since  the  fixed  base  configurations  are  worse  than  any 
other  motion  configuration.  Compared  to  ‘ a longituoinal  task, 
going  from  perfect  to  realistic  motion  introduces  less  performance 
degradation'.  Also,  motion  ameliorates  the  consequences  of  any 
visual  def iciencies . 

For  either  longitudinal  or  lateral  control,  the  performance 
change  (10-15X)  due  to  introducing  the  realistic  motion  system 
alone  is  probably  within  the  inter-  and  intra-pilot  var’*tions  that 
might  be  expected  However,  once  realistic  CGI  ;cts  are 
considered,  or  motion  is  removed  entirely,  this  is  no  longer  likely 
to  be  true  for  skilled  pilots  inasmuch  as  the  deviations  predic  ?d 
can  be  substantially  greater  than  20%. 

Table  9 gives  the  effects  of  simulator  configurations  on 
individual  rms  error  scores.  These  scores  generally  tend  to 
parallel  the  effects  shown  for  relative  performance,  as  would  be 
expected.  However,  it  is  interesting  to  note  that  predicted 
control  scores  are  less  affected  by  simulator  changes  than  are 
output  variables.  Indeed,  the  control  scores  remain  frirly 
constant  over  the  various  conditio^*  • 

The  above  model  predicticns  are  based  on  the  assumption  that 
the  pilot  will  maintain  a fixed  level  of  attention  for  the 
longitudinal  and  lateral  control  tasks  regardless  of  simulator 
configuration.  However,  in  actuality,  the  pilot  may  choose  to 
devote  more  (or  less)  attention  to  the  control  tasks,  based  on 
simulator  configuration.  To  explore  the  effects  of  such  a change 
ip  strategy,  model  predictions  were  obtained  for  various  attention 
levels.  The  results  are  presented  in  figure  7.  Note  that  the 
solid  dots  the  curves  indicate  the  nominal  levii  of  attention 
for  that  simulator  configuration.  It  can  be  seen  that  the  relative 
ordering  of  simulator  conf igurations  is  mai.itained  at  all  levels 
of  attention.  At  high  levels  of  attention,  the  performance  with 
the  realistic  CGI-perfect  VMS  configuration  approaches  that  for  the 
realistic  VMS-perfect  CGI  configuration.  Apparently,  if  the 
noise/signal  ratio  is  lowered  sufficiently  on  the  motion  cues,  it 
can  offset  some  of  the  visual  deficiencies  associated  with  the 
nominal  CGI. 


Xs  a result , inner  loop  variables  TFarTTIT  are  somewHat  less 
affected  than  outer  loop  q»aantities  (x,y,7-  a d 
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If  it  is  assumed  that  the  pilot  adapts  his  behavior  and 
increases  attention  levels  to  achieve  perforaance  equivalent  to 
that  in  \ ight , then  the  incremental  attention  required  may  oe 
consido'j  a workload  penally  associated  with  the  simulator.  The 
curves  c*  figure  7 can  be  used  to  determine  this  workload  penalty 
^ >r  maintaining  flight  level  performance  in  the  simulator;  one 
simply  determines  the  intersection  of  the  particular  sensitivity 
curve  with  the  line  of  zero  relative  performance.  The  computed 
attention  or  workload  penalties  for  the  various  configurations 
analyzed  in  Figure  7 are  given  in  table  11.  For  the  nominal  CGI 
and  motion  system,  the  pilot  would  have  to  increase  attenticn  by 
50%  over  that  needed  in  flight  in  order  achieve  the  same 
performance,  whereas  almost  three  times  as  much  attention  is 
required  for  a fixed  base  simulation. 

Effects  of  CGI  Parameters 

The  results  of  the  previous  section  suggest  that  the  visual 
processing  limitations  introduced  by  a nominal  CGI  configuration 
could  result  in  significant  deteriorations  of  closed-loop  aover 
performance-  Here,  we  examine  the  effects  of  variations  in 
individual,  design-related  CGI  parameters.  In  these  snalyses,  a 
single  parameter  is  varied  while  all  other  CGI  parameters  are  kept 
at  their  numxnal  or  realistic  values.  Results  will  be  presented 
for  both  realistic  totion  base  and  fixed  base  corf igurations . 

Figures  8 and  9 show  the  effect  of  incremental  delays  on 
relative  performance  for  motion-base  and  fixed-base  simulators, 
respectively-  Results  are  presented  as  a function  of  CGI  display 
computer  delay,  for  three  values  of  main-frame  computer  delay  (Tc)* 
Recall,  the  nominal  display  delay  is  99  msec.  For  the  range  of 
delays  considered,  relative  performance  appears  to  degrade  linearly 
as  a function  of  either  display  delay  or  main-frame  delay,  when 
motion  is  present.  Comparison  of  figures  8 and  9 (note  the 
difference  in  scale)  reveals  that  the  absence  of  motion  cues  will 
accentuate  the  deterioration  of  performance  for  a given  delay. 
Moreover,  for  a fixed  base  configuration,  performance  degrades  more 
rapidly  than  linearly.  It  can  also  be  seen  from  these  figures  that 
the  longitudinal  control  task  is  more  sensitive  to  increases  in 
delay  than  is  the  lateral  task,  particularly  to  increases  in 
display  delays. 

In  geoercii  , the  magnitude  of  the  effects  of  display  delay  are 
quite  significant.  Increasing  display  delay  from  zero  to  the 
nominal,  but  reasonably  conservative,  value  of  99  msec,  causes  an 
increase  in  relative  performance  of  approximately  20-30%  for  the 
motion-base  simulation  and  about  40-50%  for  the  fixed-base  case. 
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An  «iapiinatlon  of  the  relative  performance  values  for  zero  displt^y 
and  computer  delay  shows  that  the  effects  of  other  CGI  or  motior 
system  limitations  are  much  less  significant  (at  nominal  values) 
than  are  the  effects  due  to  delays. 

The  effects  of  f ield-of-vleu  and  display  resolution  are 
presented  in  figure  10.  Recall  that  screen  configuration  B Is  the 
nominal  configuration  corresponding  to  a 144°  horizontal , 36® 
vertical  field  of  view.  Configurations  A and  C provide  48®  by  36® 
and  144®  by  72®  fields  of  view,  respectively.  The  nominal  display 
resolution  is  1024  lines.  Both  field  of  view  and  display 
resolution  are  assumed  to  affect  observational  thresholds  as 
discussed  previously. 

It  can  be  seen  from  figure  10  that  decreasing  the  horizontal 
field  of  view  (configuration  A)  does  not  affect  longitudinal 
performance  and  increasing  the  vertical  f leld-of-view  has  no  effect 
on  lateral  performance . This  is  expected  because  of  the  assumed 
decoupling  between  longitudinal  and  lateral  control  tasks.*  Figure 
10  also  suggests  that  increasing  vertical  f leld-of^view  has  very 
little  performance  payoff  and  probably  would  not  be  Justified  on 
the  basis  of  these  results.  On  the  other  hand,  the  Improvement  in 
performance  with  increased  lateral  f ield-of-view  appears  to  be 
significant,  especially  if  the  cv  presentation  is  degraded  in 
other  ways,  such  as  poorer  resolution  or  no  motion.  For  the  500 
line  display,  fixed  base  configuration,  reduction  of  the  horizontal 
f ield-ov'-view  from  144®  to  48®  degrades  relative  performance  by 
more  than  30%. 

The  effects  of  display  resolution  are  somewhat  different  than 
^or  f ield-of-view  in  that  a greater  effect  is  observed  for  the 
longitudinal  task  than  the  lateral  task.  Witn  motion,  longitudinal 
performance  is  about  20%  poorer  for  the  500  line  display  as 
compared  to  about  a 5%  degradation  in  the  lateral  case;  for  the 
f ixed^base  configurations , these  effects  are  increased  to  about 
25-30%  and  10%.  respect ively - 

Before  leaving  this  discussion  of  the  effects  of  individual 
CGI  parameters,  it  should  be  noted,  as  a caution,  that  the 
assumption  of  a one-to-one  correspondence  with  model  parameters  is 
made  for  simplicity.  In  reality,  design  changes  can  alter  several 
factors  related  to  information  processing  and  tradeoffs  are  often 


• The  possible  effects  of  increased  field  of  view  providing  useful 
peripheral  information  on  vehicle  rates  have  not  been  examined 
here . 
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Effects  of  Vehicle  Dynaaics 

The  effects  of  slaulator  parameters  will  depend  on  the 
specifics  of  the  task,  including  the  vehicle  dynamics.  This  has 
already  been  illustrated  in  differences  between  predicted 
longitudinal  and  lateral  performance.  To  explore  further  the 
effects  of  vehicle  dynamics,  results  were  obtained  for  the  CH-47 
with  a velocity  command  control  augmentation  system,  as  specified 
in  Hoffman  et  al  (1976)  as  system  F.  The  augmented  vehicle 
presents  a significantly  less  difficult  control  task.  Figure  12 
gives  relative  performance  as  a function  of  control  augmentation 
for  the  nominal  simulator  configuration  (and  for  the  nominal 
fixe<f-base  configuration).  The  effect  of  simulator  characteristics 
is  s bstartially  less  for  the  augmented  vehicle.  However,  the 
effect  is  still  significant  for  longitudinal  control  arJ  for 
fixed-base  simulation  of  lateral  (augmented)  control. 


SUMMARY  AND  CONCLUSIONS 

The  optimal  control  model  for  pilot/vehicle  analysis  has  been 
used  to  explore  the  effects  of  a CGI  visual  system  and  motion 
system  dynamics  on  nelicopter  hover  simulation  fidelity.  This  was 
accomplished  by  expanding  the  perceptual  aspects  of  the  model  to 
include  motion  sensing  and  by  relating  CGI  parameters  to 
information  processing  parameters  of  the  model.  Simulator  fidelity 
was  examined  by  comparing  predicted  performance  and  workload  for 
flight  with  that  predicted  for  various  simulator  configurations. 

The  results  of  the  analysis  suggest  that  simulator 
deficiencies  of  a reasonable  nature  (by  current  standards)  can 
result  in  substantial  performance  and/or  workload  infidelity.  Both 

CGI  and  motion  system  effects  are  significant  for  this  task.  Them 
is  an  interaction  between  the  two  sources  of  pilot  cues.  In 
particular,  the  presence  of  motion  reduces  the  sensitivity  to  CGI 
limitations . 

With  respect  to  the  CGI  system,  the  most  important  parameter 
in  terms  of  its  effect  on  performance  was  display  delay.  This  was 
followed  in  order  of  importance  by  display  resolution  and 
f ield-of-view. 

The  main  effect  associated  with  motion  system  bandwidth  was 
introduced  by  going  to  a fixed-base  configuration.  Halving  the  VMS 
platform  bandwidth  or  going  to  full  flight  motion  made  only  a 
marginal  change  in  the  performance  predicted  for  the  nominal  VMS 
bandwidths . 
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The  trends  of  the  results  are  fairly  consistent  although  there 
were  some  differences  between  lateral  and  longitudinal  control 
tasks.  The  magnitude  of  the  effects  and  relative  importance  of 
various  parameters  are  clearly  dependent  on  the  task  as  exemplified 
here  by  longitudinal  vs.  lateral  and  unaugaented  vs.  augmented 
vehicle  dynamics.  It  is,  of  course,  for  this  reason  that  models  of 
the  pilot  vehicle  system  are  needed  to  evaluate  the  importance  of 
simulator  parameters  for  a given  situation. 
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ABSTRACT 

This  peper  serves  as  s synoptic  of  the  research  reported  In  Ref.  I.  In 
Ref.  I,  a aodel  of  the  himan  pilot  Is  offered  for  pursuit  tracking  tasks;  the 
aodel  encospasses  an  existing  nodel  for  coepensatory  tracking.  The  central 
hypothesis  In  the  development  of  this  model  states  that  those  primary  structural 
elements  In  the  compensatory  model  responsible  for  the  pilot's  equalisation 
capabilities  remain  Intact  In  the  pursuit  model.  In  this  latter  case,  effective 
low-frequency  Inversion  of  the  controlled-e lament  dynamics  occurs  by  feeding* 
forward  derived  input-rate  through  the  equalisation  dynamics,  with  low*f requency 
phase  *'droop"  minimised.  The  sharp  reduction  in  low-frequency  phase  lag  beyond 
that  associated  with  the  disappearance  of  phase  droop  Is  seen  to  accompany 
relatively  low^gain  feedback  of  vehicle  output.  The  results  of  some  recent 
motion  cue  research  are  discussed  and  Interpreted  In  terms  of  the  compensatory- 
pursuit  display  dichotomy.  Tracking  with  Input  preview  Is  discussed  In  a 
qualltlvely  way.  In  terms  of  the  model,  preview  is  shown  to  demand  no  fundamental 
changes  in  structure  or  equalisation,  and  to  allow  the  pilot  to  eliminate  the 
effective  time  delays  that  accrue  In  the  Inversion  of  the  controlled-element 
dynamics.  Precognltlve  behavior  Is  discussed  and  a model  that  encompasses  all 
the  levels  of  skill  development  outlined  In  the  succe*  slve  organizations  of 
perception  (SOP)  theory  Is  finally  proposed. 

IKTRD0OCTION 

Nearly  all  the  manual  control  displays  used  In  continuous  tracking  tasks 
can  be  classified  as  either  "compensatory"  or  "pursuit"  In  nature,  depending 
upon  the  amount  of  Information  presented  to  the  operator.  Consider  the  functional 
block  diagrams  of  Fig.  1,  which  represent  a pair  of  single-axis  tracking  tasks 
(scalar  system  Input  and  output).  In  Fig.  la  » the  operator  Is  presented  with 
a display  of  system  error  alone.  This  display,  shown  In  Fig.  2a  , Is  referred 
to  as  compensatory.  The  visually  displayed  effects  of  the  operator's  responses 
are  not  distinguishable  from  the  system  Input.  In  Fig.  lb,  the  operator  Is 
presented  with  both  system  Input  and  output.  The  corresponding  display,  shown 
In  Fig.  2b,  Is  referred  to  as  pursuit.  Here  the  operator's  corrective  responses 
can  be  distinguished  from  his  Input.  Note  that  system  error  can  be  easily 
Inferred  from  the  spatial  separation  of  the  "target"  and  "follower"  dymbols. 

It  tne  purpose  of  the  research  described  In  Ref.  1 to  provide  a struc- 
tural mouel  tor  pursuit  tracking  that  is  similar  to  the  compensatory  model 
Introduced  In  Ref.  2 and  refined  In  Ref.  3.  As  In  Ref.  3,  It  Is  hoped  that 
such  a 8K>del  can  provide  1)  a theoretical  framework  within  which  a variety  of 
empirical  pilot-vehicle  response  phenomena  can  be  Interpreted,  and  2)  some 
insight  Into  the  mechanisms  of  skill  developement . 
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THE  COKPENSATORt  AND  PURSUIT  MODELS 


Fig.  3 is  a block  dl«gr«s  of  a structural  laodal  of  the  hunan  pilot  for 
cottpensatory  behavior.  The  sodel  was  discussed  in  detail  in  Ref.  3 and  shown 
capable  of  TsatcKlng  huMn  pilot-descrihlng  functions  and  retanant  for  a wide 
variety  of  control lad-e lenient  dynanics.  The  central  hypothesis  in  the  develop- 
ment of  a pursuit  model  of  the  human  pilot  is  that  the  primary  structural 
elements  in  the  compensatory  behavior  model  also  serve  as  the  primary  structural 
elements  of  the  pursuit  model.  Fig.  4 shows  the  proposed  pilot  model  for  pursuit 
behavior.  The  primary  difference  between  Figs.  3 and  4 lies  in  the  physical 
definition  of  the  variable  u • In  the  compensatory  taodel,  u is  proportional 
to  error  (switch  position  0)  or  to  error-rate  (position  I).  In  the  pursuit 
model,  u is  postulated  to  be  proportional  to  a weighted  difference  of  error 
and  output  (position  0),  to  error-rats  alone  (position  1),  or  to  input-rate 
alone  (position  2).  As  was  the  case  in  the  compensatory  model.  Input-rate 
's  assumed  to  be  a darlvad  quantity  with  a tlma  delay  assoclatad  with  tha 

rate  calculation.  In  tha  mc^el  of  Fig.  4,  the  operation^of  the  switch  will 
be  parsmeterlsed  by  and  P^»  the  respective  probabilities  of  the  switch 
being  in  position  1 or^2  st  any  Instant.  The  probability  of  Its  being  In 
position  0 is,  of  course,  simply  1 - P.  - P^.  ?lote  that  by  allowing  • 

Yj  * ^2  * pursuit  model  Is  identical^ to  the  compensatory  model-  m 

c 

It  is  shown  in  Ref.  1,  that  the  feed-forward  of  input-rate  through  the  dynamics 
u^(j'^)/u  Cju})  can  eff actively  invert  the  control led-element  dynamics  st  low 
frsquencfss. 

Fig.  5 shows  s comparison  of  the  compensatory  and  pursuit  display  describ- 
ing functions  from  Rsf.  4 with  the  describing  functions  obtained  from  the 
compensatory  and  pursuit  models  of  Figs*  3 and  4 using  the  parameter  values 
shown  in  Table  I.  The  model  describing  functions  were  obtained  by  using  an 
approximation  procedure  discussed  in  some  detail  in  Ref.  3.  Note  the  model *s 
ability  cc  capture  the  large  low-frequency  phase  differences. 

SQHE  RESULTS  FROM  mmON-CUE  RESEARCH 

Reference  5 suanariies  some  recent  research  involving  a single-axis  piloted 
tracking  task  that  was  performed  on  a motion  simulator  constrained  to  rotate 
about  the  longitudinal  or  roll  axis.  In  an  sir-to-slr  tracking  scenario,  the 
task  consiated  of  following  the  target's  roll  angle  while  suppressing  gust 
disturbances.  Figs.  6s  and  6b  show,  respectlvlsy , a block  diagram  of  the  track- 
ing task  and  the  pilot's  compsnsatory  visual  displsv.  The  experiments  were 
perfonaed  with  (1)  no  motion,  (2)  with  full  motion  and  the  roll  axis  horixontal 
(pilot  nominally  erect),  (3)  with  full  motion  and  the  roll  axis  vsrtlcal  (pilot 
nominally  supine).  (4)  with  washed-out  motion,  and  (5)  with  sttenustsd  motion. 

The  latter  two  conditions  were  studied  with  the  roll-axis  horizontal.  The 
first  and  third  of  the  these  experiments,  and  to  some  extent,  the  fourth, 
were  dcs;.gned  to  suppress  the  so-called  "tilt  cue"  which  the  pilot  receives 
when  crai'.k^ng  with  full  motion  and  the  roll-axis  horizontal. 

Figure  7 summarizes  the  describing  functions  for  experiments  (1-3)  just 
described.  Two  distinct  describing  functions  were  measured  for  each  of  the 
experimental  conditions,  one  corresponding  to  the  Y^  of  Fig.  5 (♦  /♦  in  Fig. 
b> , and  a second  corresponding  to  5/5  in  Fig.  6.  Only  the  first  of  these 
will  be  discussed  here  since  these  tie  in  with  the  measurements  of  Ref.  4- 


If  ve  extend  our  concept  of  ''display"  to  Include  vestibular  cues*  the 
experimental  conditions  of  Ref.  3 are  quite  similar  to  the  compensatory  and 
pursuit  tracking  displays  discussed  previously.  In  the  static  case  (ST), 
of  course,  the  only  display  is  visual  and  compensatory  In  nature:  that  ls» 

^ alone  Is  displayed.  In  the  full-mot longer ect  case  (TO),  the  vestibular 
"flit  cue"  is  avallabe  as  an  additional  display  element,  effectively  giving 
the  pilot  information  about  the  coutroll^-element  output  ^ In  addition  to 
the  displayed  error  thus  yielding  a pursuit  display.  In  addition,  the 

FO  case  may  allow  higher  derivatives  of  ^ to  be  sensed  , but  the  effect  of  ^ 
this  feedback  will  be  beyond  the  frequency  range  of  Interest  here  (o)  < 4 rad/sec)  . 
When  the  cab  Is  rotated  90°  (F90),  the  tilt  cue  Is  no  l<3nger  available  to  the 
pilot,  leading  to  a compensatory  display. 

Fig.  8 illustrates  the  model-generated  describing  functions  corresponding 
to  the  controlled-elcment  dynamics  of  Ref.  5 and  the  models  of  Figs.  3 and  4. 

The  corresponding  model  parameters  are  listed  in  the  last  two  rows  of  Table  I. 

Model  parameters  were  selected  using  the  technique  discussed  In  Ref.  3.  Strictly 
speaking,  only  the  static  case  (5T  of  Fig.  7)  should  be  subject  to  comparison 
because  the  models  of  Figs.  3 and  4 are  not  specifically  formulated  for  motion 
cues  Involving  higher  derivatives  of  the  vehicle  output.  If  we  restrict  out 
attention  to  the  lower  frequencies  (u>  < 4 rad/sec),  however,  a qualltatlva.  If 
not  quantitative,  comparison  of  modeling  results  with  the  experimental  motion 
data  Is  reasonable.  As  Fig.  8 Indicates,  the  model  can  capture  the  salient 
differences  In  the  experimental  data  In  terms  of  the  compensatory-pursuit 
dichotomy  Just  suggested. 

This  limited  discussion  of  motion-cue  research  has  emphasised  the  concept 
chat  in  tracking  tasks  the  human  pilot  can  be  viewed  as  a data-organlslng 
device.  This  organisation  tends  to  be  Independent  of  the  physical  nature  of 
Che  display  and  proceeds  along  lines  suggested  by  Che  model  of  Fig.  4.  That 
is.  senaory  stimuli  tend  to  be  utilised  In  a Mnnar  that  allows  the  pilot  ot 
progiess  from  compensatory  tc  pursuit  behavior. 

TRACKIMG  WITH  PREVirW  AND  PRECOGMITm  BEHAVIOR 

Reference  1 suggests  that.  In  terns  of  the  model  that  has  been  discussed 
here  (Fig.  4),  cracking  with  preview  %rould  rest  t in  improved  performance, 
primarily  by  allowing  reduction  of  the  "open-loop"  time  delay  x.  *f  t . which 
occurs  In  feeding- forward  Input-rate.  Theoretically,  this  delay ^can  Be  reduced 
or  completely  eliminated  throuch  preview  by  allowing  the  subject  to  estimate 
c(t)  at  ^ ^ ^ °°°  garerallsas  the  concept  of  a preview  display 

to  include  an  Input  wave  form  or  stlmul'ja  Internally  genarated  by  the  pilot  in 
the  higher  levels  of  the  central  nervous  system,  then  the  structure  of  Fig.  9 
can  serve  as  a paradigm  for  manual  control  behavior  not  considered  as  tracking 
activity  per  se;  Chat  la,  tha  "pr^ cognitive"  mode  viewed  by  Krendel  and 
McRuer^  as  the  highest  form  of  skill  d«'/elopment . Fig.  9,  a slight  modification 
of  Fig.  4,  now  Includes  the  possibility  of  the  pilot  Internally  generating  a 
c(t^  '**  signal.  Nota  that  Fig.  9 encompassas  all  the  m^els  that 
describe  lover  levels  of  »klll  development  or  display  utilisation. 

CONCLUDING  REMARKS 

A model  of  the  human  pilot  has  been  offered  for  pursuit  tracking  tasks; 
the  model  encompasses  the  model  for  compensatory  tasks  introduced  In  Ref.  2 
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and  refined  in  Ref.  3.  The  central  hypothesis  In  the  development  of  this 
model  Is  that  the  structural  elements  In  the  compensatory  model  that  are 
responsible  for  the  pilot's  equalization  capabilities  remain  Intact  In  the 
pursuit  model.  The  utility  of  the  model  propsed  In  Ref.  1 and  described 
briefly  here  does  not  lie  In  Its  "predictlve"capablllty  In  the  sense  of  gener- 
ating performance  estimates*  nor  in  Its  ability  to  offer  a structure  Involving 
the  minimum  number  of  parameters  necessary  to  simulate  measured  pilot  frequency 
domain  characteristics  in  a particular  task.  Rather*  Its  value  lies  In  Its 
ability  to  serve  as  a tool  for  unifying  the  entire  base  of  single-axis  tracking 
data  and  to  provide  a rtructura  for  understanding  aspects  of  motor  skill 
development . 
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PILOT  MODEL  PARAMETER  VALUES  USED  TO  GENERATE  DESCRIBING  FUNCTIONS 
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HULTI-AXIS  TRACKING  VIA 
AN  OPTIMAL-CONTROL  PILOT  MODEL 

by 
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Prasad  and  David  K.  Schmidt 


School  of  Aeronautics  and  Astronautics 
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The  well  known  optimal  control  model  (OCM)  of  the  human  operator 
has  been  applied  nianerous  times  to  the  piloting  task,  with  air-to-air 
tracking  or  landing  approach  tasks  comprising  typical  operational  situa- 
tions. However,  almost  a11  Investigations  consider  essentially  single- 
axis tasks,  the  longitudinal  and  lateral -directional  axes  evaluated  In- 
dependently. This  approach  Is  preferred  to  limit  the  order  of  the  dynamic 
model,  and  In  wlngs-level  flight,  the  equations  of  motion  yield  uncoupled 
vehicle  dynamics. 

In  contrast  to  this  situation,  the  problem  addressed  here  is  the 
application  of  an  optimal  control  model  (OCM)  to  Investigate  tracking 
In  a highly  banked  turning  flight  condition.  The  analytical  (model)  re- 
sults are  compared  to  experimental  data  obtained  In  the  large  amplitude 
motion  simulator  (LAMARS)  at  the  Air  Force  Flight  Dynamics  Laboratory, 
Wright- Patterson  AFB. 

It  win  be  shown  that  significantly  Increased  observation  noise 
resulting  from  reduced  available  attention  and  possibly  threshold  effects, 
as  well  as  high  motor  noise  are  required  to  match  the  experimental  results. 
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THE  EFFECTS  OF  MULTIPLICATIVE  KOTOR  NOISE  ON 
THE  OPTIMAL  HUMAN  OPERATOR  MODEL 

by 

Alpec  K.  Caglayan  and  Ml II lam  H.  Levison 
Bolt  Beranek  and  Newman  Inc. 

50  Moulton  Street 
Cambridge r MA 

ABSTRACT 

The  effects  of  a multiplicative  motor  noise  model  on  the 
optimal-control  human  operator  model  have  been  analysed.  A study 
of  the  interaction  between  multiplicative  motor  noise  variance, 
plant  dynamics,  and  predicted  operator  response  behavior  shows 
that,  in  general,  an  increase  in  motor  noise  variance  produces  a 
decrease  in  operator  gain  and  a decrease  in  high-frequency  remnant. 
An  Increase  in  multiplicative  motor  noise  variance  is  also 
reflected  by  an  increase  in  the  effective  motor  time  constant;  in 
the  absence  of  a cost  penalty  on  commanded  control,  the  motor  time 
constant  equals  the  motor  noise  variance. 

INTRODUCTION 

A substantial  body  of  manual  control  data,  obtained  in  a 
variety  of  laboratory  tracking  tasks,  has  been  analysed  with  the 
"optimal-control”  pilot/vehicle  model.  For  nany  of  these  studies, 
pilot  response  behavior  has  been  reflected  in  terms  of  a relatively 
invariant  set  of  values  for  pilot-related  parameters;  specifically, 
a "motor  time  constant"  of  between  0.08  and  0.1  seconds,  a "time 
delay"  of  between  0.15  and  0.2  seconds,  and  an  "observation 
noise/signal  ratio"  of  about  -20  dB  These  tasks  have  largely 

involved  wide-band  dynamics  with  minimal  delays. 

Consistent  deviations  from  these  "nominal”  values  have  been 
noted  for  certain  kinds  of  tasks.  Of  particular  interest  here  are 
the  larger  values  for  motor  time  constant  (implying  reduced 
operator  bandwidth)  that  have  been  found  for  tasks  involving 
control  of  slowly- resoonding  systems 

The  predictive  capability  of  the  optimal-control  model  will  be 
enhanced  if  we  can  find  either  an  alternate  set  of  pilot-related 
parameters  that  are  more  nearly  invariant,  or  a consistent  rule  for 
adjusting  the  current  parameter  set  according  to  the 

characteristics  of  the  task.  The  apparently  consistent  trend  of 
the  motor  time  constant  with  resoect  to  the  resoonse 

characteristics  of  the  controlled  element  suaaests  that  this  qoa* 
is  achievable. 
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In  this  paper  we  explore  the  possibility  that  changes  in  motor 
time  co.wtant  reflect,  in  part,  a multiplicative  motor  noise 
process  underlying  human  controller  response  behavior.  The  notion 
of  a multiplicative  noise  process  is  consistent  wi'uh  the  empirical 
finding  that,  in  idealized  control  situations,  both  motor  noise  and 
observation  noise  appear  to  scale  with  the  variances  of 
corresponding  control  and  display  variables.  In  previous  studies, 
these  processes  have  been  considered  to  affect  only  the  estimator 
(Kalman  filter)  portion  of  the  pilot  model}  in  this  paper,  however, 
we  consider  the  multiplicative  motor  noise  process  to  influence  the 
control  gains. 

OPTIMAL  HUMAN  OPERATOR  MODEL  WITH  MULTIPLICATIVE  MOTOR  NOISE 

The  following  linearized  description  of  the  vehicle  dynamics 
will  be  assumed: 


x(t)  - Ax(t)  ♦ Bup(t)  + Ewg(t)  (2.1) 

where  x is  the  n-dimensional  state  vector  including  the  variables 
corresponding  to  the  gust  states,  up  is  the  r-dimensional  operator 
input,  and  Wg  is  the  white  Gaussian  process  noise  with  covariance 
Wg6(t-s).  We  will  assume  the  following  multiplicative  motor  noise 
model  for  the  human  operator '*s  input  dynamics: 

Upj(t)  «Uc£(t)  + u<,j(t)wnn(t)  (2.2) 

where  u^f  is  the  i'th  component  of  the  commanded  control  rate  in 
the  absence  of  motor  noise  and  w^.  is  the  i'*th  component  of  the 
r-dimensional  motor  noise  which  is  a white  Gaussian  process  with 
covariance  Wm  5(t-s) . The  effective  additive  noise, 
equation  2.2  will  have  the  following  properties  for  the  st^^^nary 
case: 


*«Ci*mi  • 0 <2- 3) 

Eluc^(t)Wnj^(t)I  (ucj^(8)w*j(s)l  - (Bu2j,j^)Wam5(t-s)  (2.4) 

Comparison  of  the  covariance  of  the  effective  additive  noise 
with  that  of  the  empirical  relationship  in  1 reveals  that  the 
variance  of  the  multiplicative  motor  noise  in  the  model  above 
corresponds  tc  the  motor  noise  ratio  in  1 with  a scale  factor  of 
ti  . The  multiplicative  motor  noise  model  specified  by  equation  2.2 
would  also  allow  correlation  between  the  noise  components  Wn.  for 
the  multi-input  case  through  the  off-diagonal  elements  in  the  motor 
noise  covariance  Wj,.  The  task  requirements  for  the  human  operator 
will  be  expressed  by  the  standard  quadratic  cost  functional: 
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J-lE /"(Xo(t)Qxo(t)  + Uc(t)Guc(t)dt  (2.5) 

where  Xq  is  the  state  vector  augmented  with  the  operator  input  Up. 

It  can  be  shown  that  under  suitable  regularity  conditions 

the  optimal  human  operator  control  in  the  space  of  linear  controls 
with  full  state  feedback  will  be  given  by: 

uc*(t)  - -Fxo(t)  i) 

where  the  feedback  gain  F is  defined  by 

F - (G+P(K))-lBiK  (2.7) 

with  the  po8itlve-*8emidefinite  matrix  P(R)  defined  by 

P(K)ij  • ^n+i rn+j^niji  i# j*lr2, . ..  (2.6) 

where  R is  the  positive  definite  solution  of  the  algebraic  Riccati 
equation 


KAo  + K + Q - KBo(G+P(K)  )”1b^K  • 0 (2.9) 

with  the  augmented  rystem  matrices  Aq  and  Bq  (of  dimension  n+rxn’tr 
and  ntrxr,  respecti^>ely)  given  by 

•»■[*§]  ■ [i] 

The  comparison  of  the  Riccati  equation  above  with  that  given 
i.n  reference  1 shows  that  the  control  dependent  noise  effectively 
increases  the  control  weighting  G further  by  the  term  P(K)  relative 
to  the  case  with  additive  motor  noise.  For  a fixed  set  of  control 
we  .ghtings  Q and  G,  the  effect  of  the  multiplicative  motor  noise  la 
to  reduce  the  control  gains  of  the  human  operator  from  their  values 
corresponding  to  the  additive  motor  noise  case.  This  effect  of  the 
multiplicative  motor  noise  model  is  expected  since  the  control 
effort  has  some  destabilizing  effect  on  the  system  through  the 
control  dependent  noise.  This  relationship  between  the  motor  noise 
and  the  control  gains  should  be  useful  in  modelling  the  learning 
behavior  of  inexperienced  human  operators 

The  term  G-tP(K)  in  the  Riccati  equation  2.9  can  be  considered 
as  an  effective  control  weighting  matrix.  If  the  multiplicative 
motor  noise  covariance  Wn  ir  chosen  to  be  positive  definite,  then 
P(K)  will  be  positive  definite  even  when  the  commanded  control  is 
not  penalized  in  the  human  operator''s  cost  function  (l.e.  G«0)  . 
This  result  is  intuitively  pleasing  in  that  the  multiplicative 
motor  noise  models  the  human  operator'*s  inherent  constinined 
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control  capability.  That  is,  even  if  no  explicit  or  subjective 
penalty  is  associated  with  control  activity,  the  predicted  control 
gains  will  remain  finite. 

While  it  is  possible  to  find  an  equivalent  commanded  control 
rate  weighting,  G«,  for  any  solution  of  the  Riccati  equation  (2.9) 
corresponding  to  a certain  Q,G  combination  (G^«G-i-P(R) ) , the 
multiplicative  motor  noise  model  brings  new  interpretations  to  the 
motor  time  constant  and  control  gairs  and  provides  a link  between 
the  human  operator's  control  gains  and  the  motor  noise  ratio. 
These  issues  will  be  discussed  in  the  later  sections.  In  the 
multi-input  case,  the  equivalent  control  rate  weighting  G«  would 
have  ofr-diagonal  terms  when  the  control  dependent  noise  components 
a ■»  correlated.  Therefore,  trial  and  error  search  for  an 
equivalent  control  rate  weighting  G«  would  be  more  complicated  for 
the  multi-input  case. 

The  effect  of  the  multiplicative  motor  noise  on  the  human 
operator  model  characteristics  has  been  studied  using  several  plant 
dynamics.  A lower  order  Riccati  equation  (2.9)  excludir.^  the  gust 
state  variables  is  first  solved  using  an  algorithm  similar  to  that 
in  and  then  the  the  gains  on  gust  variables  are  obtained  by 
solving  a linear  algebraic  equation  similar  to  the  deterministic 
case.  For  these  studies,  the  filtering  part  of  the  human  operator 
model  has  been  taken  from  the  pseudo  motor  noise  model  in  In 
order  to  differentiate  becwee>.  the  different  motor  noise  ratios,  we 
will  call  the  one  used  for  the  control  computations  as  the  control 
motor  noise  ratio,  the  one  used  for  the  estimator  computations  as 
the  filter  motor  noise  ratio  (called  pseudo  motor  noise  ratio  in 
^) , and  the  real  driving  motor  noise  as  the  actual  motor  noise 
ratio.  In  the  sequel,  "motor  noise  ratio"  without  an  explicit 
reference  will  imply  control  motor  noise  ratio. 

■^^'FBCTS  ON  THB  MOTOR  TIME  CONSTANT 

In  the  single  input  case,  with  G and  Wg|  scalars  in  (2.8)  and 
(2.9) , (G  > g,  W|B  - v),  the  motor  tine  constant,  Tu,  defined  as  the 
inverse  of  the  gain  on  pilot  input  Up,  will  be  given  by 

■Pn  • a + w (3.1) 

V 

where  p is  the  lower  right  element  Kn+l,n+l  solution  of  the 
Riccati  equation  (2.9).  As  can  be  seen  from  equation  (3.1),  the 
motor  time  consent  is  composed  of  two  terms:  The  first  one,  g/p, 
is  directly  proportional  to  the  control  rate  weighting  in  the  human 
operator's  objective  function.  The  second  term,  v,  is  equal  the 
variance  of  the  multipli' it .ve  motor  noise  and  corresponds  to  the 
motor  noise  ratio  defineo  in  ’,  scaled  by  a factor  of  ir. 
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The  effects  of  multiplicative  motor  noise  on  the  optimal  human 
operator  model  has  been  studied  using  the  following  set  of  vehicle 
dynamics: 
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In  aach  casa,  * .3  sac.  for  tha  huMan  oparator  ti»a  dalayr 
-90  (SB  for  tha  actual  aotor  noiaa  ratio,  -40  dB  foi  tha  filtar 
motor  noiaa  ratio,  -20  dB  for  tha  obaarvation  noiaa  ratio  wara  uaad 
for  tha  nodal  paranatar  valuaa.  Tha  plant  with  tha  rata  dynaaiica 
capraaant  a valocity  control  taak  undar  a valocity  diaturbanca 
craatad  by  a firat  ordar  noiaa  apactrun  with  a braak  fraquancy  2 
rad/aac.  Tha  filtarad  rata  dynaaica  ia  tha  aaaa  plant  aa  tha  rata 
dynanica  with  a two-pola  Buttarworth  filtar  of  cutoff  fraquancy  1 
rad/aac.  Ya»  dynaaica  rapraaant  k/u*  dynaaica  with  approximataly 
60  naac.  tina  dalay. 

Tha  affacta  of  diffarar.t  nultlplicativa  aotor  noiaa  lavala  on 
tha  aotor  tina  conatant  hava  baan  analyaad  uainq  tha  dynaaica 
abova.  Tha  control  rata  waiqhtinq,  g,  waa  choaan  to  obtain  a 
nonlnal  valua  of  .1  aac.  for  Tn  at  tha  -40  dB  motor  noiaa  laval. 
In  ganaral,  an  incraaaa  in  tha  aotor  noiaa  laval  produced  a highar 
motor  tina  conatant  T^.  Tha  raawlta  ara  tabulatad  in  Tabla  I. 
Bringing  up  tha  aotor  noiaa  ratio  to  tha  -20  dB  laval  raaultad  in 
a 101  incraaaa  in  tha  motor  tiaa  conatant  Th  coaparad  to  tha 
nagllglbla  motor  noiaa  caaa  (-40  dB)  in  all  of  tha  thraa  dynaaica 
tastad . 

ka  pradlctad  by  aeration  (3.1),  tha  aotor  noiaa  ratio  atarta 
affecting  tha  motor  tina  conatant  whan  ita  valua  ia  aroend  -20 
dB.  Thia  laval  corraaponda  to  a motor  noiaa  ratio  of  v«.C314. 
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Since  the  term  p in  (3.1)  is  a function  of  both  g and  v and  since 
increasing  v results  in  a higher  p,  the  term  g/p  decreases  as  the 
motor  noise  ratio  is  increased  to  -20  dB  level.  However,  in  all  of 
the  three  cases  tested,  the  decrease  due  to  the  g/p  term  was  more 
than  compensated  by  the  increase  in  the  motor  noise  ratio  v. 

When  the  oomauinded  control  is  not  weighted  (i.e.  g*0) , a motor 
..rise  ratio  of  -IS  dB,  as  predicted  by  equation  3.1,  resulted  in  a 
motor  time  constant  T||*.l  sec  for  all  the  dynamics  tested.  Xn  this 
case  v'.th  no  penalty  on  commanded  control  rate,  the  motor  time 
constant  To  is  equal  to  the  variance  of  the  multiplicative  motor 
r.oise  (T.l).  That  i:.,  the  motor  noise  ratio  value  completely 
specifies  Tiy  independent  of  the  plant  dynamics.  In  this  case,  the 
r.uman  operator 'd  cost  function  (2.5)  would  only  consist  of 
mean-squ.:red  error  which  is  the  real  objective  in  a ronpensatory 
tracking  task. 

EFFECTS  ON  TilE  HUNAN  OPERATOR  TRANSFER  FUNCTION 

The  effects  of  varying  the  multiplicative  motor  noise  variance 
on  the  human  operator's  eq'^ivalent  describing  function  have  been 
analyzed  by  using  the  plant  dynamics  in  the  previous  section. 
Figure  I shows  the  results  for  the  filtered  rate  dynamics. 

In  general,  for  increasing  motor  noise  ratio,  the  human 
operator's  equivalent  describing  function  gain  decreases  as 
expected  with  greatest  variation  occurring  for  frequencies  w <1 
rad/sec  andw>8  rad/sec.  Motor  noise  ratio  variation  has  a small 
effect  on  the  phase  of  human  operator's  transfer  function.  The 
greatest  change  is  around  the  8-10  rad/sec  range  since  increasing 
the  motor  noise  ratio  to  -17  dB  from  the  -40  dB  level  results  in 
the  shift  of  pole  due  to  the  motor  time  constant  from  10  rad/sec  to 
8.5  rad/sec.  "Remnant*  (control  activity  not  correlated  with  the 
tracking  input  decreases  at  high  frequencies  (o)^8  rad/sec)  as 
the  motor  noise  .atio  is  increased  to  -17  dB  level.  *This  result  is 
to  be  expected  since  the  bandwidth  of  the  controller  is  decreased 
due  to  the  increase  in  the  control  dependent  noise.  These  results 
indicate  the  conservative  nature  of  the  feedback  controller  based 
on  a multiplicative  motor  noise  model.  In  summary,  an  increase  in 
the  multiplicative  motor  noise  variance  causes  a decrease  in  the 
gain  and,  at  high  frequencies,  a decrease  in  the  remnant  for  che 
human  operator's  equivalent  describing  function. 

VARIATION  IN  Tn  WITH  OANOWlL  H 

In  this  sect.ou  we  will  discuss  how  the  multiplicative  motor 
noise  model  can  be  used  in  explaining  the  inverse  variation  of  the 
motor  time  constant  Tjj  with  plant  bandwidth.  For  this  analysis, 
the  following  set  of  dynamics  are  used: 
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These  dynamics  correspond  to  three  laboratory  tracking 
experiments.  The  plant  with  the  KSG  dynamics  represents  velocity 
control  task  under  disturbance.  BWl  and  BW2  dynamics  represent  the 
same  plant  with  a two-pole  Butterworth  filter  of  cut<  ff  frequency  1 
and  2 rad/sec,  respectively.  Model  matching  analysis  of  the  actual 
data  has  shct.*n  that  an  increast^  in  the  value  of  T^  from  .06  sec  to 
.15  sec  is  needed  as  the  bandwidtn  «s  decreased  (change  from  KSG  to 
BWl  d>namics) . With  the  standard  human  operator  model,  these 
different  values  of  are  obtained  by  selecting  a different 
control  rate  weighting,  g,  value  for  each  case,  kn  II  shows, 

with  the  multiplicative  motor  noise  based  model,  it  is  possible  to 
^latch  the  variation  in  with  only  one  value  for  the  control  rate 
weighting  g and  the  motor  noise  ratio  v. 

CONCLUSIONS 

The  effects  of  a multiplicative  motor  noise  model  on  the 
optimal-control  human  operator  model  have  been  analysed.  A study 
of  the  interaction  between  multiplicative  motor  noise  variance, 
plant  dynamics,  and  predicted  operator  response  behavior  shows 
that,  in  general,  an  increase  in  motor  noise  variance  produces  a 
decrease  in  operator  gain  and  a decrease  in  high-frequency  remnant* 
An  increase  in  multiplicative  motor  noise  variance  is  also 
reflected  by  an  increase  in  the  effective  motor  time  constanti  in 
the  absence  of  a cost  penalty  on  commanded  control,  the  motor  time 
constant  equals  the  motor  noise  varimce. 

For  the  cases  explored  in  this  analysis,  variations  in  the 
motor  time  constant  trere  accounted  for  by  fixed  values  assigned  to 
motor  noise  •'atio  and  cost  of  control.  Thus,  even  though  a new 
parameter  was  added  to  the  optimal  control  model,  the  number  of 
degrees  of  freedom  required  to  account  for  variations  in 
controlled-element  dynamics  was  actually  reduced 1 Further  %rork  is 
required  to  determine  the  extent  to  which  a fixed  set  of  cost  and 
noise  parameters  can  explain  human  operator  behavior  across  a 
variety  of  task  conditions,  including  the  differences  observed 
between  inexperienced  and  trained  human  operators 
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This  project  is  mainly  concerned  with  the  investigation  of  airplanes 
following  each  other  in  a string  as  often  occurs  during  the  landing  process, 
where  the  string  has  an  average  velocity,  %rhich  may  be  constant,  piecewise- 
constant  or  continuously  decreasing. 

The  basic  differential  equations  for  the  string  are  derived  and  modem 
control  theory  is  used  to  describe  the  charecteristics  of  the  feedback 
control  by  the  pilots.  Two  different  kinds  of  performance  indices  are  used 
and  a comparison  between  them  is  made. 

To  obtain  the  elements  of  the  coot  matrices  and  because  such  data  was 
not  available,  some  data  analyses  were  derived  using  a basic  model  for  one 
aircraft.  This  was  then  applied  to  the  complete  string  of  airplanes  by 
means  of  some  simulations  to  adjust  the  coefficients  until  some  reasonable 
trajectories  %rere  obtained. 

The  pilot's  goal  was  to  eliminate  collision  with  the  leading  airplane 
and  to  avoid  excessive  acceleration.  It  was  assumed  that  the  following 
pilot  could  not  see  more  than  two  leading  airplanes.  The  main  weighting  on 
the  feedback  was  based  on  velocity  and  distance  error. 

Some  other  factors  and  use  of  some  former  researchers  concerning  car- 
following  models  are  discussed.  These  suggest  less  error  sensitivity  when 
the  spacing  is  incre*'sing  and  more  error  sensitivity  with  decreasing  spacing. 
Variable  feedback  coefficients  %ihich  are  inversely  proportional  to  both 
velocity  and  spacing  error  are  also  taken  into  consideration.  Even  though 
the  major  portion  of  the  work  consists  of  simulation  done  with  constant 
average  velocity,  some  models  dealing  with  continuously  decreasing  average 
velocity  are  also  studied. 

The  effect  of  some  thresholds  and  different  sampling  intervals  are  also 
discussed. 

All  these  different  factors  were  supported  with  simulations  which  showed 
the  response  of  the  system  to  various  kinds  of  disturbances  by  means  of 
some  numerical  and  graphic output. 
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ABSTRACT 

The  thesis  of  this  work  Is  that  pilot  skill  development  in  the  Navy 
approach  and  landing  task  Is  very  stron^Uy  tied  to  the  'Aircraft  closure  rate 
and,  therefore,  that  pilot  training  for  this  task  should  be  based  on  an 
appropriate  progression  closure  rate*  This,  in  turn,  leads  to  a rational  and 
explicit  determination  of  design  point  approach  speeds  as  well  as  other  Impor*^ 
tant  aerodynamic  features  for  training  aircraft*  One  key  is  to  recognise  the 
significance  of  transitioning  from  a purely  coopensatory  control  loop  tech- 
nique  to  one  Involving  a pursuit  crossfeed  between  throttle  and  pitch  atti- 
tude* Such  transitioning  requires  significant  skill  development,  yet  reduces 
pilot  workload  while  enhancing  flight  path  and  airspeed  performance*  The 
second  key  is  to  address  the  terminal  flight  path  adJustTsent  in  terms  of 
range-to-go*  This  establishes  a bridge  between  the  visual  field  and  the  com- 
hlnatlon  of  manual  control  technique  and  vehicle  flight  dynamics*  A design, 
summary  plot  Is  thus  created  In  terns  of:  1)  performance  (fli^;ht  path  hand- 

width),  2)  critical  ranqe-to-go  (for  terminal  path  correction),  and  3)  closure 
rate.  This  performance-range-closure  rate  space  serves  to  map  the  training 
progression  in  light  of  the  various  critical  aircraft  and  control  technique 
constraints*  A specific  advanced  trainer  design  point  can  thus  be  established 
for  any  combination  of  primary  trainer  and  operational  fleet  aircraft* 


OVCRVir; 

Command  of  an  aircraft  consists  of  two  types  of  casks: 

1)  Psychomotor  tasks  requiring  the  pilot  to  be  active  In 
close  ! loop  regulation  of  the  aircraft  flight  path;  con- 
trol commends  are  imposed  and  effects  of  disturbances 
are  suppressed* 

2)  Discrete,  normally  open-loop,  tasks  wherein  the  pilot 
corminleates,  navigates,  operates  systems,  etc*;  these 
tasks  usually  arc  not  required  to  be  performed  at  an 
exact  time  but  during  i specific  time  period* 
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!>urinfi>  a maneuver,  Che  portion  of  available  tine  requlte<!  for  performin'^  the 
psvehonutor  flylnft  tasks  Is  called  *'attentlonal  workload**  In  the  literature 
kefs*  1 and  2)* 

Tlie  oethodolo^.y  and  rationale  for  psychotootor  skill  development  applied 
here  follows  the  Successive  Orj»inl«atlon  of  Perception  (SOP)  theory  of  manual 
control  derived  from  Krendel  and  McRuer  (Ref*  3)*  This  hypothesis  of  psycho* 
motor  skill  development  is  based  on  the  concept  that  a supervisory  control 
system  of  the  human  dominates  the  learning  process*  It  Is  the  limitation  of 
the  supervisory  system  that  sets  the  pilot  workload  margin;  as  skill  Is  devel* 
oped  In  a given  sensory*^tor  task  » supervisory  Involvement  and,  hence, 
perceptual*motor  loading  (l*e*,  workload)  becone  less*  Furthermore,  it  is 
theorized  that  skill  development  Involves  a progression  from  an  lnstant*by* 
Instant  conscious  perceptuaI*motor  action  to  execution  of  progranned  responses* 
The  three  stages  of  development  are  described  by  this  theory  of  manual  control 
skill  development  to  he: 

• Compensatory;  the  pilots  acts  mainly  in  response  to  an 
error  signal  (he  Is  "behind  the  aircraft**)* 

• Iiirsult;  most  of  the  pilot's  actions  are  laamed 
responses  to  discrete  perceptual  rues  or  ssts  of 
perceptual  cues* 

• Precognltive;  most  or  the  pilot's  set  ions  are  executions 
of  learned  control  routines  and  strategics* 

These  three  stages  of  skill  development  represent  levels  of  the  pilot's 
workload  capacity* 

In  actual  flight  situations,  the  pilot  attempts  to  cope  with  each  control 
task  by  use  of  strategies  which  reduce  his  workload  and  improve  his  perfor* 
nance*  Pilots  reach  their  maximum  performance  capacity  when  they  gain  the 
ability  to  primarily  use  precognltive  skills  for  aircraft  control* 

ttETHODOLOCY  AI:D  APPROACH 

Tlie  thesis  of  this  specific  application  is  that  the  pilot's  skill  develop* 
ment  In  the  Kavy  approach  and  landing  task  Is  very  strongly  tied  to  the  air* 
craft  closure  rate  and,  therefore,  that  pilot  training  for  this  task  should  be 
based  on  an  appropriate  progression  In  closure  rate*  This,  In  turn,  leads  to 
a rational  determination  of  design  approach  speeds  as  well  as  other  key  aero* 
dynamic  features  for  training  aircraft* 

The  following  sumnarlzes  the  analysis  approach  for  choosing,  In  parti* 
cular,  the  design  point  for  a»«  advanced  Jet  trainer  in  the  context  of  the 
night  carrier  approach  task*  This  context  Includes  a variety  of  important 
factors,  l.e., 

• Prescribed  longitudinal  piloting  technique* 

• Overall  nulclaxls  control  task* 
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• DcslreH  manual  control  perfomancei  l«e*»  mlnlmim  path 
errors  and  system  stability* 

• Aircraft  flight  dynamics  (flij^ht  path,  speed  or  AOA)« 

• Outside  visual  perception* 

• Keed  for  excess  tinte  to  communicate  t^ith  LSC,  instruc- 
tor pilot  (IP),  etc*]* 

Most  important,  we  are  able  to  view  these  factors  In  terma  of  the  progression 
of  trail  ina  from  introduction  to  the  primary  trainer,  through  an  advanced 
trainer,  to  the  fleet  aircraft* 

The  analysis  approach  that  covers  the  above  Is  illustrated  in  Fi<»*  1* 

It  be?,lns  with  a statement  of  the  task  and  a prospectus  of  the  control  loop 
structure  needed  to  accomplish  chat  task*  A control  loop  analysis  is  then 
performed  to  identify  the  important  features  of  the  vehicle,  of  the  displays 
(outside  visual  and  cockpit  instruments),  and  of  the  piloting  technique* 
Following  that,  we  estimate  the  pilot’s  discrete  task  duty  cycle  and  compare 
that  to  hxs  fmiltiloop  excess  control  capacity  in  order  to  assess  his  partition 
of  workload  between  continuous  and  discrete  tasks*  Pi lot /vehicle  performance 


Fi^'^ure  I*  Flow  diagram  of  process  for  selection  of  flight 
media  requirements  based  on  Imposed  workload 
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Is  brought  Into  the  analysis  alon"  with  visual  notion  efffects*  and  this 
finally  pemlts  us  to  formulate  a manageable  quantification  of  all  factors  in 
connon  terns.  The  resulting  overall  system  parameters  consist  of  aircraft 
snoe'^  (airspeed  and  closure  rate),  aerodynamic  fllqht  path  sensltivxty 
(pj  ),  ranqc-to-qo,  and  rlloH^"  technique  (rej»ardtnq  fliqht  path  and  speed). 

\ bridqe  common  to  each  of  these  parameters  is  the  height  regulation  handwtdth 
(expressed  as  crossover  freauency,  (»^^). 

The  problem,  briefly  stated.  Is  to  accomplish  a manual  rnproach  and 
landing  in  the  fleet  nl«?ht  CV  environment  and  to  consider  the  training:  nro-* 
fjression  required  to  build  up  to  this.  The  Navy's  prescribed  pilotin'^  tech- 
nique specifically  calls  tor  hel^qht  corrections  with  throttle  and  speed  (or 
AOA)  corrections  with  pitch  attitude.  TaVen  literally,  this  corresponds  to 
our  concept  of  a parallel  compensato  y loop  structure  (with  an  Inner  series 
loop  of  pitch  attl-ude  controlled  by  elevator). 

A key  point  of  the  analysis  is  that  a purely  compensatory  structure  will 
not  permit  satisfactory  execution  of  the  approach  and  landlnp  task,  especially 
In  adverse  conditions*  Pother,  the  pilot  must  ultimately  develop  a pursuit 
crossfeed  of  throttle-to-«*ttltude  in  order  to  enable  full  realixation  of  the 
aircrafe^’^s  fll<»ht  path  regulation  potential  (see  Flj?.  2).  This  pursuit  crofs- 
feed  satisfies  the  prescribed  Navy  technique,  but  it  brings  about  e quantum 
decrease  In  pilot  workload  (increase  in  excess  control  rapacity)  with  a com- 
mensurate inprover/ent  in  flight  path  performance.  We  see,  in  fact,  that  the 
crossfecd  becomes  essential  to  success  in  the  CV  environment  as  approach  speed 
increases  to  that  tvplcally  encountered  In  fleet  aircraft  (l.e.,  fllt^hter/ 
attack) • 

Two  key  parameters  describe  Che  lelevant  airplane  dynamics,  i*e*,  total 
airspeed,  V,  and  nor?wl  acceleration  sensitivity,  (■  /C|^  or 

These  parameters,  for  example,  provide  accurate  estimates  o?  atti  :ud'  * 
constrained  speed  and  heave  nodes,  l/T®^  and  l/T^^*  respectively.  .l/Tj,  • 
(^f^z  above  parameters  est«Mlsh  limits  on 

path  and  speed  regulation  for  qlvcn  pllotlnj»  technique  variations,  especially 
compensatory  versus  pursuit  crossfeeds. 

• Comfortable  compensatory  bandwidth  ^ l/T^j  (■  (2/n2^)(,q/V)  1 • 

• Limit  compensatory  bandwidth  (•  /7  (g/V). 

• limit  pursuit  cro8«feed  ^indwldth  (■  1/T0J  1“ 

“nic  above  constraints  are  mapped  in  the  norfoiTtance-ranqe-closure  rate 
space  in  Fig.  The  piloting  technique  and  aircraft-dependent  determined 
limits  are  shown  as  normallxcd  performance  measures,  and  arc  characterised  by 
the  nomallred  flight  path  bandwidth  and  ranqe-to-go.  The  normalliation  of 
the  scales  relates  the  differences  in  aoproach  speed  between  the  advanced 
trainer  and  fleet  aircraft  to  the  skill  level  hat  the  student  acquires  at  the 
end  of  his  primary  training*.  Unity,  on  the  ranqe-to-qo  scale,  at  end  of  ori- 
mary  tralnln:*  is  200  feet  distance  and  the  correspondlnr  fll.qht  path  perfor- 
mance is  a bandwidth  frequency  of  0.5  radians  per  second.  *^anqe-to-qo  is 
defined  as  the  pilot's  final  path  correction  distance.  These  normalized 
metrics  provide  standards  relative  to  student  skill.  The  illustration  in 
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between  tliroltlc 
and  attitude 


Fiture  2.  Covparlacm  of  pilot  loop  structure  forma  (in 
terms  of  Successive  Orgsnitstlon  of  Psrcertlon) 
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Vln.  4 lmMciite«  that  foi  a night  carrlt;  approach,  rha  dralgn  point  la 
lOS  kmns  airsp«rd  for  a 20  ki*ot  headwind  with  path  reaponae  (n*,,)  appror- 
t«atelv  equal  to  1.0  This  level  oi  n.  Is  established  bv  the  need  to  in- 
sure that  the  stinleTit  reaches  his  res^nse  Unit  for  the  pursuit  control 
technique.  Cy  a.iiieving  this  uf  sMll  he  will  be  capable  of  operat- 

tnK  to  the  alrf ra»e-dependent  Hail  fcr  the  fleet  aircraft.  The  Rovern- 
inn  factors  are  the  pilot's  perspective  view  of  the  Fresnel  lens  aensi- 
t'.-itv  and  landing  area. 


Figure  Approach  pertorsiance  design  constraints  of 
aircraft  for  night  qualification 


TRAINING  IMPLICATIONS 

A training  scenario  can  be  derived  froai  the  analysis.  As  sho%m  in 
Fig.  5,  the  student's  skill  developMenc  begins  with  the  prlnary  trainer 
at  Point  A.  For  clarity,  the  sitfll  arrows  are  used  to  trace  t>e  student's 
skill  develoosMnr  while  the  "bolder"  arrows  Indicate  points  for  advance- 
ment In  training.  In  his  "naive"  state,  the  student  applies  the  pre- 
scribed Navy  flight  path  control  technique  In  Che  conoensatory  manner. 

At  this  level  of  proficiency,  the  governing  aircraft  parameter  Is  the 
attitude-constrained  speed  mode,  1/tej  ■ (2/n,^) (g/V) , %ihere  Is  the 
normal  load  factor  sensitivity  to  change  in  angle  of  attack,  V Is  true 
airspeed,  and  g is  the  gravitational  constant. 

As  his  proficiency  Increases  from  the  compensatory  level,  his  per- 
formance improves  until  he  reaches  an  Intermediate  performance  constraint 
(l.e..  Point  B)  Imposed  by  the  aircraft  phugoid  response  characteristics  (u; 1 
in  radians  per  second. 
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ri**Mr*»  Trnl«^lv  'tctnjrio  mivticstM  (or 
nl  •►t  mwUflcutlon 


Tu'  cnn*H>t  It'nrev^  hit  otrfor^tec  beyo«0  (Hit  tolnc  lanltut  Hm 

Icims  n no  re  cf^Uleiit  control  Tilt  ocotm  thttwch  tho  TV  oronot** 

In*  An>^  toTf-or.-*iittisl‘^'*.  (i*c*»  V>?>*  The  ntn\tm**f  nnnlrc^  Is  a control  rM*- 
fn-  uch*il(>oe  ((•«••  croiitfrctfT  hrtuM^n  thrott!r  nttftuio*  T%t«  to-cJ*llo4 
•**^4»rHu{t  control’*  f-i|»o«ct  no  tc»?ficlonnl  vori^loAf*,  mod  Incrtntot  hit 

vKcvtt  control  ctiwiclty*  r:>on  '^f  thr  niirtnlt  control,  hit  fmrfor- 

’.’^ncr  enn  nocent laity  ht  tutondccl  to  tht  «lrcrtft*t  henrt  *y^e  Uotc  yirm 
'»'•  l/T^^  - n,  o^lch  it  rolot  C.  necnitso  of  t‘'it  •*tinethorin*t**  httoten 

coot roV’axrt,* the  ttiw»tnt  reaches  a •*olatcnw**  o(  Droflcloncy*  Thtn  ••trnl^ine 
.'Vite-'n**  is  A **00(1  Unit**  I’hich  st«r»  fro^  t'm  Inherent  tire  4e\ayt 

ii  prt>ce^Hln«'»  tfni  rxecntlon,  tn**  eisunl  setnnin**  fre«|otncy  Unit*  In  n nrtc- 
cici*  tense,  this  IWt  enrirt  hetveen  snbiects*  At  ^sint  C,  the  ttmhrnt^t 
re*'ortoirc  of  shills  hat  ifihroeoft  tnfficiently  to  to  «n  t(letnco<l  tmlntr* 

In  this  a*W4nco«t  trainer,  <fenen^inr  tines  the  incre*mt  aonroiich  sneM  tint 
Te^tee  lost  in  ritual  corTCtpofi<*enca,  the  stmlent  oil  I reotrttm  to  a hinbly 
sh tiled  c»j^*^ntntory  state  at  indicated  hy  t^  •hsjld’*  uTtm  at  ^Int  f'*  thte 
to  the  c’tan^e  in  approach  apeedt,  hit  eiauat  cues  at  t*ie  critical  ran<^  for 
decisions  of  the  adranceil  trainer  do  not  corret^nHtd  to  those  learned  in  the 
nri'^ary  trainer*  Me  rsist  laam  the  net#  prerlett  ptrsnectiee,  and,  in  ao  doiin* 
he  represses  to  the  cnrfienaatory  techni<^tiat  until  the  ritual  cues  and  ti^lno 
St  r ite  *y  necessary  for  adranc(n««  to  the  pursuit  technlmic  tiara  hton  re* 
est.th\tshe«<  at  V\o  M**Hur  nnprnach  snoed  nf  tV  sWancei'  trainer  iVoint  Tl* 

The  final  nro?rrs»ion  in  t^ie  learning  cyels  is  the  transition  to  the 
fl*‘*:t  alrcrifi,  an*  !s  considered  the  nr  .lor  hurdle  (!h>int  fl*  Consenuentlv, 
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vanctsi  tr-ilii^fr  am!  tN*  fl^*t  aircraft*  •Witv  re*ri'<*l«%a  la  t^roflclo'^y  uccwra, 
'tit  tW  sti**V*at  acct^  oalv  faM  Sac^  to  tl'c  curs  laar^i!  tl'c  t«!v<i«ica<l 
tr'lacr*  e mintuit  tecMltuia  an?»llcii  to  tMa  coo#i|tt*»c^  oat*  t^c  st^nleat 
ts  ftiMy  car».tSle  of  -^ro^'ranatn**  In  akiU  to  the  ll-lt^  of  tHc  fleet  aircraft* 


'^»r  foHovrto*'  aolrta  aay  be  lofecre<l  fron  the  above: 

1)  ^*r  fl!~it  |oth  oerfofTooer  oetrle  (t*e*«  cloae^^Kor 

hAO»?vt  lt^')  In  tlie  critical  rnn*^r— to-^  re«*lo«  w *• 

iint«|tie  rcanwre  %/*'1ch  la  aeosltlw  to  el  lot  c«*ctrol 
nlmte  ao«t  nitot  f»roftcleocy  trvrl*  TSla  rctrlc  coul** 
lo'*tcally  Se  »iacf*  to  «*otcr^loo  uhco  a at«.4ont  ahonl»* 
a*vaocc  In  training* 

for  tlie  atufiont*  trnoaltlon  fron  the  nrl*nary  trainer 
envlron-neot  to  t’le  O'Wanccf*  trainer  fa  i-ore  challen^'ln'' 
tNnn  fna*  t*ie  advanc«Hi  tra!ner  to  tlie  fleet  aircraft » to 
turrs  of  ia|»oac<l  %mrhloa*l*  Initial  re^resaton  of  tecH-^ 
ol.^uc  le  to  Se  eK!^te«*  at  tl»e  erlnary  to  advancof*  trao* 
titloo.  Nit  verv  little  re*:reaslon  l«  nroflcleocy  le 
•"cr^IsalMo  la  transit lonlv*  to  the  fleet  aircraft* 
^lorefore*  visual  corresfwnleoce  between  tiiese  aircraft 
is  naintalut'* 

3)  Increase*?  tralaln?  tine  be  requirot*  if  ® bi>h 

annronch  sreel  locrercat  occurs  'letuccn  r!ic  prl^^nry  an*i 
a*!vaocc»l  trainer* 

A)  AIrcrift  characteristics  %?hicb  eninance  trnlaln’*.  nronres- 
sloo  arc  e^cnlicltly  .<leterMne«!* 
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INTRODUOTIOH 


In  order  to  disclose  the  characteristics  of  the  hunan  pilot  vho  controls 
the  multi^variable  systen,  ve  have  to  investigate  both  the  control  behavior 
and  the  scanning  behavior.  Researches  on  pilot *s  scanning  behavior  during  the 
actual  operation  of  airplanes  have  been  conducted  previously,  froa  which  the 
data  concerning  the  scanning  properties  aaong  various  instnnents  have  been 
already  obtained^.  Furtheraore,  various  models  of  pilot's  dynamics  based  upon 
multi-variable  manual  control  experiments  have  been  constructed^*^.  There  are, 
however,  very  few  which  summarise  these  scanning  properties  taking  account  of 
the  various  control  situations  vhez^  the  pilot  is  actxially  placed. 

The  aim  of  this  paper  is  to  investigate  the  scanning  behavior  and  the 
control  behavior  of  the  pilot  who  manually  controls  the  tvo-variable  system, 
which  is  the  most  basic  one  of  multi -variable  systems.  In  our  experiment,  ve 
set  up  two  control  tasks,  which  simulate  the  actual  airplane  attitude  and  air- 
speed r ntrol.  In  order  to  simulate  the  change  of  the  situation  where  the 
pilot  is  placed,  such  as  changes  of  flight  phase,  mission  and  others,  the 
subject  was  requested  to  vary  the  weightings,  as  his  control  strategy,  upon 
each  task.  Changes  of  hunan  control  dynamics  and  his  scanning  properties 
caused  by  the  modification  of  the  situation  have  been  investigated. 

By  use  of  the  experimental  results,  the  optimal  model  of  the  control 

behavior  and  the  scanning  behavior  of  the  pilot  in  the  two-variable  system  is 
proposed  from  the  standpoint  of  making  the  performance  index  minimal.  This 
model  enables  us  to  predict  both  the  optimal  human  control  dynamics  and  the 
optimal  scanning  properties.  The  model  validation  is  done  comparing  the 
model  predictions  with  the  experimental  results. 

EXPSIIKEHT 


The  previous  works  have  already  pointed  out  that  the  pilot's  scanning 
behavior  varies  according  to  the  instruments  he  attends  to;  namely,  the  dwell 
time  on  the  flight  director  is  relatively  long  and  spreads  widely,  whereas,  the 
dwell  time  on  ether  instruments,  such  as  the  airspeed  indicator,  is  short  and 
remains  almost  constant^.  Referring  to  this  fact,  the  subject  is  assigned  to 
two  tasks,  the  main  task  and  the  side  task,  each  having  different  character- 
istics in  this  experiment.  As  shown  In  Fig.l,  each  error  between  the  forcing- 
function  and  the  output  of  the  controlled  element  is  displayed  on  each  CRT. 

The  subject  actuates  the  respective  controller  by  making  use  of  the  displayed 
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information.  Thus,  each  control  loop  forms  a compensatory  tracking  task.  AS 
ve  postulate  the  situations  similar  to  the  actual  operation,  ve  chose  as  the 
main  task  the  stable  controlled  element  to  vhich  the  random*«ppearing  forcing* 
function  is  added,  and  as  the  side  task  the  unstable  first*order  controlled 
element  to  vhich  no  forcing  function  is  added.  The  following  three  kinds  of 
controllM  elements  are  deployed  for  the  main  task: 

CcBa.(s)  ■ 5/(  *2  ♦ ^5  ♦ 5 ) , (1) 

Gca2(a)  ■ 1/*  . (2) 

Gc3(s)  - 1 ; (3) 

while  the  controlled  element  for  the  side  task  has  a first-order  divergent 
dynasd.cs: 

Gcs(s)  » 0.3/(  s - 0.3  ) . (U) 

On  the  other  hand,  in  order  to  evaluate  the  total  control  performance,  the 
performances  of  both  the  main  task  and  the  side  task  oust  be  considered.  In 
this  paper, 

J • K,  e,(t)2  Ka  e,(t)2  (Ki»  ♦ K,  - 1)  (5) 

was  postulatwl  as  th«  total  perforaance  index,  where  e,{t)2  and  eg(t)2  are  the 
mean-squared  error  of  the  main  task  and  the  side  task  respectively.  and 
Ks  are  vei^ting  coefficients,  and  these  are  considered  to  be  variable  accord- 
ing to  the  change  of  situati<Hi,  such  as  flight  phase  or  rdssion,  in  case  of 
the  actual  operation.  Referring  to  £q.(5)«  ve  change  the  experimental  mode  by 
directing  the  weightings  verbally.  The  experisiental  mode  are  as  follows: 
node  9m  : put  more  lighting  on  the  min  tssk  (Ka  > Ks) 
mode  9iS  ; einost  equalise  the  weightings  (Km  > Ks) 
sKxfe  9ts  ; put  more  weighting  to  the  side  task  (Kq  < Ks)* 

The  results  of  the  experiment  are  stnmarised  as  follows  ^ 

1)  As  seen  in  the  time  history  indicated  in  Fig. 2,  the  control  of  the  main 
task  is  done  almost  continuously,  whereas,  the  control  of  the  side  task  has 
the  tendency  to  be  interrupted  during  the  period  between  fixations. 

2)  The  dwell  time  on  the  main-task  display  is  relatively  long  and  spreads 
widely,  whereas,  the  dwell  time  on  the  side-task  display  is  short  and  almost 
constant , 

3)  The  control  performance  of  each  task  varies  according  to  the  weightings. 

As  Indicated  in  Fig. 3*  the  dwell  time  on  the  display  of  each  task  varies 

according  to  the  weightings.  This  change  is  observed  in  the  dwell  time 

on  the  main- task  display.  The  dwell  time  on  the  side-task  display  remains 
almost  constant. 

The  mean  value  of  the  sum  of  the  both  dwell  times  is  defined  as  a scanning 
period.  The  scanning  period  varies  according  to  the  dwell  time  on  the  main- 
task  display,  since  the  dwell  time  on  the  side-task  display  is  almost  constant. 

/ Figs. 3 and  7 indicate  that,  when  the  scanning  period  T increases,  the  main- 
task  control  performance  becomes  better,  while  the  side-task  control  perforsK 
ancc  becomes  worse. 

As  the  main-task  control  can  be  considered  to  be  continxious,  we  can  apply  the 
time  series  analysis  using  Multiple  Final  Prediction  Error  method  to  the  data 
of  the  main  task^. 
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6)  Using  the  results  of  the  tlM  series  smlysis,  the  describing  functions  of 
the  pilot  are  obtained*  These  show  the  tendency  for  the  gain  to  deteriorate 
as  the  scanning  period  becoaes  shorter. 

On  the  other  hand,  the  control  of  the  side  task,  which  seeas  to  be  intern^ted 
between  fixations,  indicate  that  the  pilot  perceives  both  the  error  and  its 
rate  of  change  during  a short  dwell  tiae* 

T)  As  shown  in  Pig*6,  there  is  a proportional  relationship  between  the  aagni* 
tude  of  error  and  the  pilot's  control,  when  pilot's  eyes  are  fixed  on  the  side- 
task  display.  The  pilot's  gain  for  the  side  task  has  a tendency  to  decrease 
when  the  scanning  period  becoaes  longer. 

NQDILIKG 


Ve  propose  here  a aodel  of  the  scanning  behavior  based  upon  the  resxU.ts 
of  the  experiaent.  This  aodel  consists  of  the  optiaal  control  aodels  for  both 
tasks  and  the  optiaal  scanning  aodel. 

Since  the  control  of  the  aain  task  appears  to  be  continuous,  the  pilot's 
optiaal  transfer  function,  which  ainiairss  the  perforaance  index, 

• e^(t)2  ♦ k^c»(t)2  , (6) 

is  derived  froa  Wiener's  optlaua  filtering  theory.  Here,  e^  and  c^  denote  the 
error  and  the  control  of  the  aain  task  respectively.  The  effects  of  the  scan- 
ning are  dealt  by  adding  the  relevant  observation  noise  to  the  systea.  In 
Ref.  2,  there  is  an  exaaple  of  assualng  the  power  spectrua  density  of  the  obser- 
vation noise  ♦w  by: 


♦w  ■ Ts  e2  / » , (7) 

where  Is  is  the  saapling  period  of  the  display  and  e^  is  the  aean  squared 
error.  Referring  to  Eq*(7),  we  assume  that  the  ratio  of  the  aaplitudes  of  the 
observation  noise  up  to  t[ rad/sec]  and  of  the  error  corresponds  to  the  square 
of  the  ratio  of  the  dwell  time  on  the  side-task  display  T^s  and  the  scanning 
period  T,  naaely  the  power  spectrum  density  of  the  relevant  observation  niose 
♦vv  is  assumed  to  be  obtained  by  the  following  equation: 

♦w  • ( Tds  / T )2  eM(t)2  . (8) 

The  dwell  time  on  the  side-task  display  T^s  rsaains  alaost  constant  in  all 
the  cases.  For  the  model,  we  fixed  as; 

Tdi  • O.h  (nee]  . (9) 

Thus,  the  pilot's  optimal  transfer  function  and  the  main-task  performance  can 
be  obtained  as  the  function  of  T.  Fig.U  shows  a comparison  of  the  frequency 
response  of  the  optiaal  model  obtained  above  and  the  pilot's  describing  func- 
tion obtained  froa  the  experiment.  Fig. 3 shows  the  experimental  results  of  the 
control  perfoimance  and  the  prediction  by  the  optimal  model.  It  seems  possible 
for  the  model  to  predict  the  average  of  the  experimental  values  if  T is  given. 

The  modeling  of  the  control  of  the  side  task  is  based  upcm  the  descrete- 
time  optimal  regulator.  Here,  we  replaced  the  sampling  period  with  the  scan- 
ning period,  assualng  that  one  piece  of  Information  Is  perceived  at  one  fix- 
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ation  aikd  that  the  pilot  controls  in  such  a way  that  he  interrupts  his  control 
during  the  period  betveen  fixations.  When  the  controlled  element  of  the  side 
task  is  the  first-order  unstable  system  as  Eq.(U)«  the  pilot's  optimal  control 
model  has  proportional  characteristics;  the  gain  of  the  model  changes  according 
to  the  scanning  period  T.  As  shown  in  Fig.6,  there  is  a proportional  relation- 
ship between  the  error  (i.e.  pilot's  input)  and  the  pilot's  output,  and  it 
Indicates  a good  accord  with  the  gain  of  the  optimal  control  model.  Moreover, 
as  seen  in  Fig. 7,  the  control  performance  of  the  side  task  for  each  T can  be 
predicted  by  using  this  model. 

As  stated  above,  the  control  performance  of  each  task  is  predicted  by 
employing  the  optimal  models  for  both  tasks  as  the  function  of  the  scanning 
period  T.  According  co  £q.(5)»  the  total  task  performance  is  also  obtained 
as  the  function  of  T.  The  optimal  scanning  period  T satisfies  the  equation: 

dJ  / dT  • 0 . (10) 

Comparisons  betveen  the  model  prediction  and  the  experimental  values  of  the 
dwell  time  on  the  main-task,  display  are  shown  In  Fig. 8,  imder  aasmptlons  that 
the  dwell  time  on  the  side-task  display  is  held  constant  and  that  the  follow- 
ing  weightings  can  be  applied  to  the  experiment:  * 0.6-0. 8 with  mode  WM, 

n o.U-0.6  with  mode  WE,  Km  ■ 0.2-0. U with  mode  WS.  Kote  that  in  Fig. 6,  the 
average  of  the  display  dwell  time  is  expressed,  these  results  indicate  that 
ve  esn  predict  the  scanning  behavior  by  using  the  proposed  model. 

CONCUJSIOK 


By  setting  up  an  experimental  conlition  similar  to  the  actual  operation 
of  airplanes,  t'lc  data  of  two-varlahle  ntftnxial  control  system  were  successfully 
obtained.  It  was  confina*^  that  the  pilot's  control  dynamics  and  his  scanning 
properties  chanf^  the  weightings  put  on  the  two  assigned  task.  The  pro- 
posed pilot  model  in  the  tvo-variable  manual  control  system  can  predict  both 
the  pilot's  dynamics  and  the  average  tendencies  of  the  scanning  properties. 
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INVESTIGATION  OF  A SUM  OF  SINUSOIDS 
REPRESENTATION  OF  GAUSS-MARKOV  RANUOM  PROCESSES 
- IMPLICATIONS  FOR  MANUAL  C0..TR0L  RESEARCH 

R.L.  Mohr  and  A.V.  Phatak 

Analytical  Mechanics  Associates.  Inc. 

Mountain  View,  CA 

R.A.  Hess 

NASA/Ames  Research  Center 
Moffett  Field,  CA 

Abstract 

An  Important  problem  In  the  design  of  piloted  simulation  experiments 
Is  the  selection  of  appropriate  mathematical  models  for  the  external  wind 
gust  disturbance  Inputs.  Wind  gust  turbulence  spectra  are  typically  re* 
presented  as  gauss-markov  random  processes,  such  as  the  "Oryden*  or 
"Preyss-Meadows"  models.  Assuming  that  turbulence  spectra  are  rational, 
these  models  provide  an  efficient  and  adequate  approach  towards  simulating 
the  effects  of  external  gust  disturbances.  However,  such  gauss-markov 
gust  models  are  not  necessarily  the  best  representation  to  use  If  the 
objectives  of  the  manned  simulation  experiments  are  not  merely  ei'.  rical 
experimental  analysis  but  Include  the  Identification  of  a dynamic  Input* 
output  pilot  model.  The  drawbacks  of  using  gauss-markov  disturbance 
models  relate  to  the  statistical  properties  of  the  pilot  model  parameter 
and  spectral  estimation  procedures  when  finite  data  segments  are  used 
for  Identification.  These  problems  do  not  arise  If  a sum  of  sinusoids 
Is  used  to  model  the  gust  turbulence  spectra.  At  present,  the  number, 
relative  amplitudes,  frequencies  and  phase  angles  of  the  sinusoids  are 
selected  to  match  the  characteristics  of  the  desired  sp.'Ktrum  according 
to  some  qualitative  or  quantitative  criterion.  Furttermbre,  these 
representations  are  used  Interchangeably  In  the  formulaticn  of  optimal 
control  theoretic  models  for  the  hunan  operator,  which  reqiire  tne 
assumption  of  state-space  "Internal  mooels"  for  the  plant/dsturbance 
dynamics. 
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Recent  mrk  has  sKown  the  lapact  of  varying  internal  avxiels  for  the 
random  disturbances  on  the  optimal  control  model  describing  function  and 
remnant  outputs.  Therefore,  a better  understanding  of  the  relation<hip 
between  idem  signals  and  sum  of  sinusoids  representation  should  provide 
valuaole  naight  into  plausible  internal  models  for  the  plant/disturbance 
dynamics  adopted  by  the  trained  himmn  operator. 

This  paper  presents  results  of  a preliminary  investigation  into 
the  mathematical  relationsh.p  between  a state^space  model  for  external 
distui^ances  to  a pilot-vehicle  system  and  an  "equivalent**  deteministic 
sum  of  sinusoids  representation  of  that  disturbance.  Systematic  model 
structure  determination  and  maxiwi  likelihood  parameter  identific  ion 
are  applied  to  sum  of  sinusoids  data  and  variables  (as  in  standard  k. 
k/s  and  k/s^  laboratory  tracking  tasks)  excited  by  sum  of  sinusoids 
data  . The  purpose  was  to  study  the  effects  of  various  parameters* 
such  as  run  length.  sai|>ling  rate,  and  simi  of  sinusoids  variables  {number. 
relative  ai^)lltudes.  frequencies  and  phase  angles)  on  the  Identified 
state  space  model  structure  and  parameter  estimates. 

The  results  are  compared  to  state-space  models  asstmmd  by  previous 
investigators,  and  the  Implications  to  man-vehicle  simulation  and  human 
operator  modeling  are  discussed. 
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SOMIARX 

The  accurate  and  efficient  identification  of  the  huaan  operator 
is  still  a need  in  himan  factors  Mglneerlng  especially  con- 
cerning nulti variable  control.  Control  theoretic  identification 
snthods  need  to  be  tested  with  h«»an  operator  aodels  under  re- 
alistic boundary  conditions.  The  requirenants  and  criteria  for 
the  use  of  parasMtric  nethods,  selected  aodels  as  well  as  tbs 
Haxlnun  Likelihood  Method  and  the  Extended  Falnen  Filter  are 
displayed.  The  nT[riir1nnnts  and  results  are  canparatlvly  dis- 
cussed fron  the  point  of  practical  engineering. 

ZMTRKXXICTiaN 

The  nultlvariable  control  of  san-naschine-systee»  by  the  huaan 
operator  will  raws  in  even  in  highly  coeqplex  systaaw  like  pre- 
sent and  future  aircraft  generations.  For  exaaple,  questions 
concerning  crewconcepts  nust  also  be  answered-  in  the  field  of 
continuous  auumal  control  not  only  in  categories  of  decision 
theory.  In  the  optinization  of  nanual  controlled  systeaw  the 
id«>tlfication  of  the  huaum  operator  is  a stqiposition  to  solve 
this  task  on  analytical  sMthods.  For  this  purpoae  som  andels 
for  the  nanual  control  of  single  and  nultlvariable  control  have 
been  developed  an  tested  /I,  2,  3/.  The  use  of  even  efficient 
nodels  as  a tool  for  design  engineers  is  noznally  restricted  by 
the  capacity  of  identification  anthods  and  generates  the  need 
for  powerful  identification  a{q>roaches. 

In  the  past  non-paranetrlc  anthods  were  preferred  «dilch  produced 
an  operator  description  in  graphical  fozn  like  the  Bode-plot. 

This  curve  had  to  be  approxinated  by  those  of  a nodel  to  achieve 
an  analytical  fotn.  Generally  the  weighting  function  or  transfer- 
function  via  correlation  a«thods  were  coaputed.  The  expense  in 
computing  tiiae  and  effort  «iere  hi^  and  noznally  only  capable  in 
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r^sMrch  ^xpmximmntM  and  In  slngln  varinbl*  control  tasks.  Ths 
idsntlfication  of  aodsl^paraMtsrs  and  InforMtion  about  ths 
hussm  opsrator  rsanant  wars  not  availabls  in  ths  ssm  Idsatifl* 
cation  run. 

In  ths  last  yaars  in  Ids^tiflcation,  par sm trie  asthods  bassd  on 
sstination  thsory  bscaas  availabls  and  wars  tsstsd  on  tschnlcal 
systsas  /4/.  Thsss  rssults  cannot  bs  transfsrrsd  on  aan-MChlns* 
systsns  without  furthsr  Invsstlgatlons  for  ths  boundary  condl* 
tlons  ars  not  conparabls.  In  ths  h\SMn  factors  flsld  paraastrlc 
Mthods  %isrs  oftsn  ussd  with  rsstrlctlons  In  ths  opsrator  aodsl 
(no  rsmnant)  or  In  spsclal  control  situations  %isrs  parts  of  ths 
nodsl  wars  nsglsctabls  (tlM  dslay)  or  unusual  fonts  appsarsd 
(all  slsmsnts  of  ths  stats  vsetor  nsasurabls) . 

Ths  ala  of  this  work  Is  to  tsst  parsMtrlc  Mthods  without  spscl* 
fie  rsstrlctivs  assuaptlons  to  gain  sxpsrlsncs  on  thslr  vsrsa^ 
tlllty  as  an  snglnssrlng  tool  for  a broadsr  scops  of  control 

tasks. 

Starting  with  rsqulrsasnts  for  nodslllng  qusstlons  of  ths  Idsntl* 
flablllty  of  ths  Quasl-llnsar  Modsl  and  ths  Optlaal  Control  Nodsl 
havs  to  bs  answsrsd  and  also  attsntlon  has  tc  bs  paysd  on  ths 
convsrgsncs  crltsrla  of  ths  Idsntlflcatlon  Mthods  undsr  tsst. 
Thsss  ars  ths  Maxlaua  Llksllhood  Msthod  and  ths  Sxtsndsd  Kslssn 
Flltsr.  Both  wars  ussd  In  Idsntlfylng  ths  cosiputsr^sisulatsd  Mn-> 
Mchlns^systsM  Including  ths  huaan  opsrator.  Also  sxpsriMnts 
with  manual  control  tasks  psrforasd  by  tsstpsrsons  wars  achlsvsd. 
Ths  accuracy  and  convsrgsncs  In  rsgard  to  ths  softwars#  hardwars 
and  computing  tlM  sxpsnss  will  bs  valuatsd. 

REQUIREMENTS  AND  CRITERIA  FOR  THE  USE  OF  PARAMETRIC  METHODS 

Idsntlflcatlon  Mthods  ars  charactsrlssd  by  thslr  convsrgsncs. 
This  includss  that  thsy  svaluats  ths  trus  parsMtsrs  with  a 
minimum  of  Masursd  data  and  odnlmum  srror.  A vary  dsslrabls 
quality  Is  an  asymptotic  unblassd  sstlmats  with  minimum  varlancs. 
Ths  achlsvablllty  of  this  psrformancs  dspsnds  on  ths  Idsntlfl-^ 
cation  Mthod  Itsslf  and  on  ths  structurs  of  ths  sM^Hiachlns^ 
systsm*modsl. 

Ths  Maxlmum*Llksllhood  Msthod  provldss  this  quality  If  a canoni- 
cal form  of  ths  man-MChlns-systsm-modsl  Is  found  and  som  othsr 
conditions  concsarnlng  ths  data  acquisitions  ars  fulflllsd  /6/« 

Ths  Extsndsd  Kalman  Flltsr  will  only  rsach  suboptlMl  sstlMtss 
in  ths  dsscrxbsd  ssnss  for  ths  llnsarlsatlon  of  ths  systsm-modsl 
and  ths  varlancss  will  always  bs  grsatsr  than  that  of  a minimum- 
varlancs-sstlmator  /S/.  Nsvsrthslsss  ths  uss  of  canonical  forms 
supports  convsrgsncs. 

For  singls-variabls  control  canonical  forms  havs  unlqus  solutions 
which  is  not  trus  for  multlvariabls  control  modsls  and  in  addi- 
tion ths  effort  to  acAlsvs  a canonical  form  Is  sxtrsmly  higher 
/8/. 

Normally  ths  human  opsrator  modsls  do  not  havs  a canonical  form 
in  thsir  orgin  so  that  ths  modsl  paraMtsrs  and  ths  "canonical*' 
parameters  ars  not  identical.  Ths  Identification  Mthod  will 
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•atlMt*  th«  "canonical*  paraaatara  which  hava  to  ba  traaafoxMd 
back  into  nodal  paranatera  to  vntk  with.  This  raquiras  tha  da- 
tanlnistic  Idantif lability  of  tha  nodal  paranatars  out  of  tha 
canonical  fozn  /7/.  Thasa  -aquiriants  do  not  only  concaxn  that 
a hunan  oparator  r^dal  can  oa  anployad  for  idantifying  paranatars 
fron  raal  data  and  Is  not  only  abla  to  dascriba  hunan  bahawiour. 
Basidas  tha  parfomanca  in  convarganca  tha  usafulnass  of  an 
Idantlflcatlon  nathod  as  an  anglnaaring  tool  in  hunan  factors 
has  also  ba  takan  into  account  by  tha  on/of f-lina  capability* 
naadad  conputar-slsa  and  conputing  tins. 

MODELS  AND  IlffiMTXFICATIOH  METBOOS  OHOER  mVESTIGATZON 


For  tha  tasting  of  paranatar  astlnati^  nathods  ondar  husnn  fac- 
tors conditions  validatad  hunan  oparator  sndals  warn  usad.  Tha 
discussion  of  tha  nodals  in  a ganaral  sansa  was  not  tha  subjact 
of  tha  rasaardi.  To  raduoa  tha  affort  in  eonputar  and  progran 
handling  a singla  ccmtrollad  variabla  task  was  ehosan  with  a 
first  ordar  wahicla  dynanic  (fig.  1).  This  doss  not  rastrict  tha 
validity  of  tha  rasulta  in  raspact  to  sniltivarlabla  control  for 
tha  structura  of  tha  nan-nachtna-systan-nodala  and  tha  idantlfi- 
cation  snthods  covar  both  casas. 

Soaw  varsions  of  tha  Quasi-llnaar  Nodal  and  tha  Optinal  Control 
Modal  warn  chadcad  if  tha  aan-asrhlna-systasi-Bodal  including  than 
could  fulfil  tha  raqulransnts  for  a structura  which  can  provida 
nininun-varianca  astinatas. 

Tha  systan  with  tha  (Riasl-llnaar-Nodal  is  Icoal  idantifyabla 
for  tha  sodals  MOO  3 and  MOO  5 (fig.  2)  and  only  for  sona  vary 
xastrlctad  paranatar  spacas  for  MOO  6.  This  last  statsnsnt  is 
also  valid  for  tha  varslon  of  tha  Optinal  Control  Nodal  proposad 
cs  idantifyabla  in  /2/.  All  nodal  varsions  ara  daslgnad  for 
slngla-varlabla  control  that  a canonical  or  nlnlaal  foxn  can  ba 
found  with  a uniqua  solution.  Tha  prasantation  of  tha  nan-nachlna- 
systastHKMlal  is  writtan  In  tha  stata-spaca  dascrlptlon 
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It  is  an  axtandad  aquation  of  a standard  canonical  fom  of  tha 
oparator  modal  and  contains  ona  additional  non-zaro  alanant  for 
tha  vahlcla  dynamic.  With  tha  asaui^tlon  that  this  dynamic  is 
known  this  alamant  is  no  paranatar  to  ba  astimatad  so  that  this 
ainimal  fom  fulfils  tha  critaria  for  convarganca  of  tha  idantl- 
ficatlon  smthods  in  usa. 
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Thtt  Mia  pr^I«a  arlMS  th«  origin  par«Mt«r«  Imv*  to  b«  eoai- 

putod  fran  tho  oloaonts  of  tho  ostlMtod  par— trr  iroctor  In  r«- 
tuzn.  In  th«  casoa  of  NOD  € and  NOD  B this  loads  to  oxtensiso 
anslyticsl  oxprossions  with  highsr  oxdor  tsxas  dopsnding  on  tho 
soloctod  padB-spproxiMtion  of  tho  tins  dolsy.  In  tho  frsM  of 
tasting  idsntificstion  astbods  tho  offort  to  obtain  a solution 
was  not  boarablo  for  tho  Optlaal  Control  Nodol  and  all  oxporl- 
awnts  woro  porfonaad  with  tho  Quasi- linoar  Nodol  (NOD  3 - NOD  €) . 

Tho  Kaxlaw-Likolihood  idontiflcatlm  as  an  acknowlodgcd  and 
powerful  awthod  in  control  onginoorlng  was  choson  and  tho  Bx- 
tondod  Kalsian  Filtor  for  its  principal  on-lino  capability.  With 
tho  iaqploawitation  of  tho  Haxisnaa-Llkolihood  Hathod  on  tho  nan- 
nach Ino-syatan  undor  invostigation  arisos  tho  problon,  that  tho 
covarianco-natrix  of  tho  aaaanrmanr  noiso  is  singular,  for  tho 
vohlclo  output  contains  no  noiso  with  tho  assusption  that  undor 
laboratory  conditions  nsaauranant  noiso  can  bo  nogloctod.  tho 
raamant  on  tho  othor  hand  nust  bo  intorprotod  as  noasursnont 
noiso.  Tho  singularity  of  tho  covarianco-auitrlx  prowonts  a 
stoady-stata  solution  of  tho  Riccatl-oquation  in  tho  Likolihood- 
cosputor.  Tho  following  dlroctions  havo  boon  triod  to  by-pass 
this  difficulty: 

- Opon-loop-Llkolihoodcoaputor 

Likolihoodcooputor  with: 

- roducod  ordor 

- virtual  noasuroaMnt  noiso 

- naasuroMnt  of  ono  stato  varlablo 
(hoBMn  oporator  output) . 

Tho  last  way  proved  to  bo  tho  officiant  ono  in  achiovablo  ac- 
curacy and  offort  /9/. 

Thoso  problaas  do  not  ariso  in  laplanontlng  tho  Extondod  Kalaan 
Filtor  for  a stoady-stato-solution  is  not  aspirod.  Tho  Marlwin 
Likollhood  nathod  usos  dlscroto  stato  aquations  but  continuous 
paraawtors  aro  ostlnatod  by  tho  Gauss-Mowton  algoritfan.  This 
division  into  dlscroto  stato  aquations  and  continuous  parasMtor 
astlsMtlon  is  not  possiblo  with  tho  Cxtandod  Kalswn  Filtor.  Tho 
continuous  filtor  was  choson  to  provont  a transfom  fron  tho 
Laplaco-donain  into  x-dosMiin  and  in  rovorso  for  tho  lattor  would 
induce  analytical  difficultios. 

In  tho  axpariannts  tho  naln  attontion  was  payed  to  tho  following 
item  concerning  convorgonco: 

- Holso-to-slgnal  ratio  of  ronnant/hunan 
oporator  output 

- Order  of  husMn  oporator  node Is 

- H:nbor  of  sMSsurod  data  sots 

- Soloctod  starting  values. 

Both  parasMtric  nathods  woro  coaparod  with  tho  results  of  a cross- 
corrolation-analysls  on  tho  saaw  data.  This  ackncslodgod  aMthod 
in  human  factors  was  porfonaad  via  FFT  and  a Direct  Search  to 
obtain  an  analytical  expression  out  of  tho  Bode-plot. 
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EXPBiaMENTS  AMD  RESULTS 


All  msntlonttd  Identification  aethods  ware  tasted  on  acqulsltia  ad 
data  froa  a aan-aachlna- system  computers laulatlon  and  on  data 
Bwasured  with  testpersons.  Xn  the  coaputerslBulatlon  the  human 
operator  model  was  Implemented  with  an  exact  tUae  delay.  The 
resuiant  and  the  disturbance  were  introduced  as  filtered  white 
noise  Into  the  control  loop.  During  the  Identification  with  the 
simulation  derived  data  the  identification  method  used  the  same 
model  as  the  simulation  except  the  padi^approxlmatlon  of  the 
tlM-delay.  All  model  versions  were  tried  out  on  the  testpersons 
data. 

The  results  are  sunmarlzed  In  fig.  3 and  5.  The  label  of  the 
identification  program  is  referred  to  the  s»del's  label  of  fig.  2. 
All  times  in  the  table  are  based  on  the  described  computer  type 
and  on  2043  data  sets  trtilch  were  measured  with  20  cps. 

Beginning  with  the  Maximum- Likelihood  Method,  a asymptotical  con- 
vergence Is  achievable  with  all  versions  of  the  used  operator 
model  If  the  starting  values  are  selected  properly.  The  number  of 
values  leading  to  convergence  reduces  with  the  model's  order. 
Increasing  nolse-to-slgnal  ratio  of  the  remnant  gains  the  esti- 
mation error  and  the  number  of  Iterations  necessary  to  reach  the 
maximum  of  the  llkellhoodf unction.  Increasing  the  number  of  data 
Increases  the  accuracy  but  levels  out  at  1SCX)  data  sets.  The  ac- 
curacy Is  within  good  acceptance  for  all  model  versions  and  also 
for  remnant  levels  well  above  that  of  typical  human  operators. 

The  Identification  of  the  testpersons  data  gives  results  which 
could  be  expected  for  a first  order  dynamic  of  the  controlled 
element.  The  MaximusrLlkellhood  f^thod  could  be  validated  also 
for  these  real  world  data  for  the  '\rasMtersets  of  all  models 
applied, generate  an  equivalent  trsnai.  r function. 

The  Extended  Kalman  Filter  requires  more  comutatlon  time  per 
cycle  than  available  on  a 20  cps  data  acquisition  basis.  So  an 
on-line  use  Is  not  possible.  This  time  cannot  be  reduced  signi- 
ficantly due  to  the  chosen  continuous  filter  and  the  Runge- 
Ku tt a- algor 1 thm . 

The  filter  Is  very  sensitive  to  the  selection  of  starting  vali.es 
which  Influences  the  speed  and  the  accuracy  of  convergence  ccnsl- 
derably.  Another  disadvantage  Is  that  the  covariance-matrix  li- 
cludlng  tne  remnant  must  be  known  d priori.  The  estimation  of 
the  remnant  covariance  influences  also  the  convergence  of  the 
filter.  For  there  Is  no  possibility  except  a faster  computer  to 
accelerate  the  filter  algorithm  Into  a region  where  on-line  com- 
putation can  be  performed. The  filter  was  not  used  with  higher 
order  models  which  would  Increase  computation  time  again. 

Comparing  the  parametric  Identification  methods  the  superiority 
of  the  Maximum-Likelihood  Method  Is  shown  (fig.  3).  If  the  cross- 
correlation analysis  in  the  here  Implemented  sophisticated  form 
is  taken  Into  account  this  is  not  that  clear  for  It  takes  a 
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12~fold  coaqputatlcat  tine.  Th«  cross-correlation  analysis  can  be 
applied  very  easily  on  a spectrtnt  of  aodels.  The  prograsBln^  of 
the  Maxiaum-Itilcelihood  Method  is  always  special  for  each  of  the 
BK)del  version  and  needs  more  algebraic  effort.  Nevertheless  for 
higher  order  sndels  the  MaxlauB-Likellhood  Method  is  the  most 
accurate  (fig.  4) . 

CONCLUSIONS 

The  Extended  Kalman  Filter  could  not  fulfil  on-line  requir sswnts ■ 
In  comparison  with  the  Filter  and  a sophisticated  cross-correla- 
tion analysis  the  Maximum-Likelihood  Method  proved  to  be  the  most 
accxirate,  but  the  analysis  with  FFT  and  Direct  Search  is  faster 
and  needs  not  to  be  programmed  for  every  model  version.  Identifi- 
cation of  real  human  operators  and  the  sianilaticn  showed  that  the 
Maximum-Likelihood  Method  and  still  the  cross-correlation  analysis 
are  powerful  instrusMnts  for  engineering  in  human  factors  even 
without  restrictive  models  or  conditions.  More  attention  should  be 
payed  to  identifyable  multivariable  models  for  the  human  control- 
ler. 
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This  research  has  involved  the  development  and  testing  of  a psycho- 
logically-based  computer  simulation  designed  for  measurement  of  strategy 
changes  during  the  learning  of  continuous  control  behavior.  Strategy  in 
task  periormance  is  beli^v^^y  many  to  be  an  important  determinant  of.  the 
quality  of  performance.  * ’ What  comprises  an  individual's  control 
strategy?  First,  as  defined  in  this  research,  it  inc?  :des  criteria  for 
behavior ial  output  in  various  aspects  of  the  task.  These  criteria  include 
subjective  performance  standards  and  criteria  associated  \ith  the  style  of 
motor  movements.  Second,  an  individual's  control  strategy'  guides  criteria 
for  perceptual  input.  This  includes  selective  attention  to  certain  envir- 
onmental cues.  Finally,  control  strategy  dictates  how  attention  is  allo- 
cated to  mental  processes.  This  includes  a sequence  for  those  mental 
processes  which  make  high  demands  ^n  mental  resources,  sad  hence  cannot  be 
perforsmd  in  parallel.  In  summary,  control  strategy  has  been  defined  for 
this  research  as  the  set  of  parameters  determining  the  functi(\iing  of 
mental  processes  important  in  manual  control. 

It  has  been  suggested  that  variation  in  control  strategy  is  the  means 
by  whjch  the  individual  tailors  his  behavior  to  the  demands  of  a specific 
task.  Thus,  measurement  of  control  strategy  could  permit  identification 
of  important  individual  differences  among  trainees.  Control  strategy  is 
sensitive  to  the  nature  of  environmental  cues,  and  its  measurement  will 
allow  better  identification  of  the  effects  of  these  cues.  This  is  espe- 
cially important  for  the  design  of  training  simulators  where  the  inclusion 
of  a minimal  set  of  critical  cues  can  greatly  increase  cost-effectiveness. 

The  aim  of  the  research  is  to  measure  human  control  strategy  through 
use  of  a psychologically-based  computer  simulation  which  reflec  s a 
broader  theory  of  control  behavior.  The  simulation  is  called  the  human 
operator  performance  emulator,  or  HOPE.  HOPE  was  designed  to  emulate 
control  learning  in  a one-dimensional  preview  tracking  task  and  to  measure 
control  strategy  in  that  setting.  When  given  a numerical  representation  of 
a track  and  information  about  current  position  in  relation  to  that  track, 
HOPE  generates  positions  for  a stick  controlling  the  cursor  to  be  moved 
along  the  track.  In  other  words,  HOPE  generates  control  stick  behavior 
corresponding  to  that  which  mi^t  be  used  by  a person  learning  preview 
tracking. 

the  basic  organisation  of  HOPE  is  depicted  in  Figure  1.  HOPE  vac 
designed  to  be  consistent  with  the  psychological  literature  on  mental 
processes  in  continuous  control.  For  example,  in  HOPE  there  is  a distinc- 
tion made  between  meats 1 processes  which  demand  considerable  mental  re- 
sources, such  as  performance  monitoring  and  evaluation,  and  thos^^  pro- 
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Figure  1«  Organlxatlofi  of  cb«  Humq  Operator  Perfor«ei  ce  Emulator  (MOPE) 


cesses  which  demand  minimal  resources*  such  as  exccucior  of  an  already 
selected  motor  command.  In  HOPE*  processes  believed  to  be  mentally 
demanding  are  performed  by  the  Supervisory  Processor  in  a serial  fashion. 
Less  demanding  processes*  such  as  command  execution  or  coMand  selection* 
the  accessing  of  a stored  motor  cosBand*  are  done  in  a more  parallel 
fashion.  HOPE  improves  its  performance  by  building  a Command  Memory 
descrii 'ng  control  stick  positions  appropriate  for  moving  between  specific 
pair^  of  cursor  positions.  This  feature  allows  HOPE  to  model  learning  and 
to  model  control  of  both  linear  and  non-linear  control  dynamics. 

Control  strategy  is  represented  in  HOPE'S  operation  by  control  strat- 
egy parameters  which  dictate  how  certain  processes  function.  The  current 
ROPE  includes  three  control  strategy  parameters:  Command  Operative  Time* 
ERRLIM*  and  ADJUST.  Covmand  Operative  Time*  or  COT*  is  an  upper  limit  on 
the  frequency  with  which  nc^  control  stick  positions  are  selected*  and 
affects*  for  example*  Comand  Execution.  It  is  sensitive  to  cues  such  as 
track  frequency.  Shorter  Command  Operative  Times  are  more  appropriate  for 
more  quickly  varying  tracks*  where  position  must  be  changed  more  frequent- 
ly. ERRLIM*  a subjective  performance  standard*  dictates  the  amount  of 
cursor  position  error  allowed  before  drastic  action  is  taken  to  reduce 
position  error.  ERRLIK's  value*  either  large  or  small*  dictates  whether 
the  performance  sK>nitor  In  HOPE  judges  performance  as  acceptable.  As 
ERRLIM  grows  larger*  a larger  position  error  is  tolerated  before  major 
corrective  action  is  taken.  ADJUST*  the  third  control  strategy  parameter* 
helps  determine  the  magnitude  of  the  corrective  adjustment  taken  in 
response  to  excessive  error.  A large  ADJUST  represents  more  aggressive 
corrective  action. 

These  control  strategy  parameters*  Command  Operative  Time*  ERRLIM* 
and  ADJUST*  represent  aspects  of  human  control  strategy  in  the  learning  of 
s one-dimer  'onsl  preview  tracking  task.  How  is  HOPE  used  to  measure  human 
control  strsw  ,gy?  Subjects  are  asked  to  perform  a one-dimensional  preview 
tracking  task.  Subjects  are  asked  to  use  a control  stick  to  keep  a cursor 
on  the  center  line  of  an  apparently  randomly  curving  track*  scrolling  down 
from  Che  top  of  a screen.  The  cursor  can  be  controlled  only  in  the 
horizontal  dimension*  moving  left  and  right.  The  plant  dynamics  are  non- 
linear* and  allow  first  order*  position  control  of  the  cursor.  As  the 
subject  performs  this  Cask*  his  control  stick  position  is  recorded  every  40 
msec , 


HOPE  operates  on  a mmierxcal  representation  of  the  same  track  as  chat 
followed  by  the  subjects  HOPE  is  run  multiple  times*  each  time  using  a 
dirferent  set  of  control  strategy  parameter  values  and  generating  a dif- 
ferent pattern  of  control  stick  positions.  Each  run  generates  a HOPE  model 
of  human  behavior  sad  learning  guide!  by  a particular  control  strategy. 
Current  testing  i?^volves  generation  of  100  '^odela  of  behavior  using  all  of 
the  possible  combinations  of  five  values  of  COT,  five  values  of  ERRLIM  and 
four  values  of  ADJUST  (see  Figure  2). 
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FIGURE  2.  HOPE  SEHERATiai  OF  TOELS  OF  STRATESY-CaiTWLLED  lEHAVIOH 
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Hicrd  control  stick  pORitions  in  a given  ti«R  interval  ere  Mtched  ggeinst 
each  HOPS  nodel's  control  stick  positions  for  that  saae  interval.  The  root 
Man  square  difference  score  is  used  to  pick  the  HOPE  aodel  which  heat 
Mtches  hMsn  behavior  during  that  tiM  interval.  The  values  of  the 
control  strategy  parameters  modulating  the  SOPS  ok>del  that  best  Mtches 
human  behavior  are  identified  as  the  human  control  strategy  for  that  inter'- 
val. 


This  approach  to  Maaurement  using  HOPS  has  received  som  validation 
testing,  the  res* Its  of  which  are  quite  encouraging.  BOPS  models  are  able 
to  Mtch  human  control  stick  behavior  remarkably  well.  In  preliminary  and 
ongoing  validation  tests,  HOPE  models  have  succeeded  in  Mtching  over  90S 
of  the  subject  contro)  stick  behavior  generated  within  lOX  of  the  control 
stick's  range  of  motion.  Figure  3 illustrates  the  similarity  of  hiaaan  and 
HOPE  control  behaviors,  as  srell  as  the  improveMnt  in  Mtching,  when  the 
control  strategy  in  HOPE  is  permitted  to  vary.  In  addition  to  HOPE'S 
ability  to  Mtch  human  behavior,  the  human  control  strategies  identified 
by  HOPE  have  intuitive  appeal  in  view  of  tracking  requirements.  For 
example.  Figure  4 depicts  the  averages  of  the  CosMnd  Operative  TiMS 
measured  for  four  subjects.  These  subjects  had  five,  three--minute  trials 
tracking  • random  track  with  a % Ha  cut-off  frequency.  Then  they  tracked 
five  trials  of  a random  Rx  cut-off  frequency  track,  followed  by  five 
trials  on  the  ssm  H Ht  track  as  they  experienced  earlier.  Their  Manured 
CoMand  Operative  Times  are  longer  on  trials  with  the  \ Hx  track  and 
shorter  on  trials  with  the  h Hx  track.  These  changes  Mke  sense  in  view  of 
the  more  'spidly  varying  nature  of  the  H Hx  track. 
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Figure  3.  Suple  of  control  stick  positions  usod  by  s subject  during  ten  tine 
bins  of  trseking  snd  those  used  by  (e)  the  HOPE  aodel  which  best- 
notches  hunsn  behavior  during  each  2 sec  tine  bin»  (b)  chose  gener- 
ated by  a single  HOPE  aodel  for  :he  tine  Crane  tracked  by  the  sub- 
ject. The  subject  had  experienced  about  9.2  minutes  of  tracking 
a 1/4  Hx  cut-off  frequency  track  when  this  saaple  was  taken. 
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FIGURE  4.  HOPE  £ST!?1RTIS  OF  HWI  D»MD  OFERRTlVt  Tl?€ 
FOR  Jm  TRACK  CONOITKXIS  - ICAIIS  FOR  A SAHPLE 
OF  FOUR  SUUCn  ARE  INDICATED  t 3RACKETED  3Y 
OiC  STANDARD  DEVIATION  OF  SUBJECT  ESTINATES 
AIOCV)  THE  ICAN. 


These  results  are  encouraging  and  suggest  that  BOPS  can  provide  a 
useful  suppleaent  to  current  Msaures  of  manual  control  behavior.  BOFE  has 
particular  potential  because  it  can  Mature  behavior  in  a variety  of  condi- 
tions for  irhich  current  nodels  uere  not  originally  designed.  In  a new 
tracking  environMnt,  HOPE  begins  with  no  data  on  the  for«  of  plant  dynam- 
ics or  on  the  external  forcing  function,  but  builds  up  a repreaentatioo  of 
this  knowledge  froai  experience  in  the  task  in  a way  that  is  representative 
of  huean  learning.  Since  HOPE  models  the  learning  of  control  dynamics,  it 
can  be  used  to  Mssure  the  control  strategy  of  both  trained  and  ontrsl^cd 
operators.  HOPE  models  preview  tracking  behavior,  an  important  instance 
of  control  behavior  largely  unaddressed  by  other  current  sM>dela.  Finally, 
and  most  importantly,  HOPE  can  model  and  Msaure  a rich,  psychologically 
meaningful  representation  of  hMsn  control  strategy.  Meaa**reMnt  of  con- 
trol strategy  through  use  of  HOPE  has  great  potential  for  ^roving  our 

under staading  of  the  changes  in  behavior  that  occur  during  ning,  for 
allowing  us  to  describe  individual  differences  in  behavior,  & aiding  the 
design  of  effective  training  of  control  behavior,  and  for  providing  in- 
sight into  how  unobservable  mental  processes  and  structures  are  operating. 
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ABSTRAa 


The  optimal  control  model  of  a human  pilot  has  been  used  in  previous 
studies  in  an  attempt  to  model  and  understand  a pilot's  discretionary  be* 
havior  in  departure-prone  maneuvering  tasks  for  a fighter  aircraft.  When 
the  pilot  model's  internal  model  of  the  aircraft's  dynamic  response  is  dif- 
ferent from  the  actual  aircraft  dynamics,  pilot-aircraft  instabilities  can 
be  pedicted  that  are  very  similar  to  observed  piloting  difficulties.  This 
paper  attempts  to  verify  the  predictions  and  conclusions  of  the  previous 
studies  by  rigorous  analysis  of  the  aircraft  control  time  history  predicted 
by  the  optimal  control  pilot  model  and  actual  pilot  tracking  data  obtained 
from  NASA  Langley's  Differential  Maneuvering  Simulator  (DHS).  The  analysis 
is  performed  using  a hypothesis  testing  scheme  modified  to  allov  for  changes 
in  the  true  hypothesis.  A finite  number  of  pilot  models,  each  vith  different 
hypothesized  internal  model  representations  of  the  aircraft  dynamics,  are 
constructed.  The  hypothesis  testing  scheme  determines  the  relative  proba- 
bility that  each  pilot  model  best  matches  the  DHS  data.  By  observing  the 
changes  in  probabilities,  it  is  possible  to  determine  %rhen  the  pilot  changes 
control  strategy  and  which  hypothesized  pilot  model  best  represent's  the 
pilot's  control  behavior. 


IHTRODUCTION 


When  a pilot  controls  and  monitors  an  aircraft,  it  is  recognized 
([l]»  [2])  that  the  pilot  uses  an  internal  model  of  the  system  to  determine 
a control  strategy.  The  assumption  of  a perfect  internal  model  appears  to 
be  satisfactory  in  many  instances  where  the  pilot  has  mastered  the  skills 
necessary  to  execute  maneuvers  vith  precision.  There  are  situations,  how- 
ever, in  which  the  pilot's  internal  model  can  differ  significantly  from  the 
aircraft's  dynamics.  Examples  of  these  situations  include  rapid  maneuvering, 
which  causes  significant  .changes  in  the  aircraft's  angle  of  attack,  and  com- 
ponent failures. 

The  optimal  control  pilot  model  is  a complex  optimal  control  system 
which  has  been  shown  to  capture  fundamental  aspects  of  human  operator  control 
behavior  ([3],  [4])  and  is  constructed  using  a perfect  internal  model  of  the 
system  being  controlled.  Previous  studies  ((5],  [6])  have  investigated 
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the  use  of  the  optiasl  control  pilot  sodel  to  investit^te  the  effects  of  sn 
intemsl  aodel  nisastch  by  the  pilot  in  sn  effort  to  predict  piloting  diffi* 
culty.  In  [5]  snd  [6],  the  effect  of  intemsl  aodel  vsristion  vss  studied 
slong  s wind-up  turn  nsneuver.  The  sngle  of  sttscs  of  the  piloted  sircrsft 
incresses  signxf icsntly  slong  the  wind-up  turn  Moeuver.  Six  results  shout 
pilot-sircrsft  stsbility  were  obtsined  in  the  study:  (1)  The  pilot  aodel 

essily  stsbilized  the  sircrsft  throughout  the  asneuver  using  i perfect  In- 
temsl nodel  of  the  sircrsft  dynsaics;  (2)  If  the  pilot  aoocl  is  control- 
e 

ling  the  bsre  frsae  using  only  Istersl  snd  longitudinsl  stick*  the  pilot- 
sircrsft  systea  hss  s divergence  instsbility  (unstsble  sprisl  aode)  if  the 
pilot  aodel  keeps  s low  (below  12  deg  flight  condition  intemsl  aodel 

of  the  sircrsft  while  the  sircrsft's  sctusl  flight  condition  exceeds  16  deg 

(3)  The  pilot  aodel  csn  coapensste  for  control  difficulties  beyond  16 

<i«g  without  chsnging  the  low  intemsl  aodel  by  using  Istersl  stick  snd 

pedsls;  (4)  Difficulties  csn  still  occur  beyond  25  deg  using  stick  snd 

pedsls  if  the  pilot  aodel  keeps  s low  control  strstegy;  (5)  If  only 

pedsls  sre  used,  no  difficulties  sre  encountered  up  to  30  deg  %dien  the 

pilot  aodel  keeps  s low  intemsl  aodel  of  the  sircrsft;  (6)  If  s psr- 

ticulsr  sileron- rudder  interconnect  systea  is  sctivsted*  the  pilot-sircrsft 

divergence  instsbility  is  eliainsted*  but  the  Dutch  roll  aode  csn  becoae 
unstsble.  These  results  tend  to  sgrec  with  observed  behsvior  of  s huasn  pilot 
flying  the  sircrsft  with  the  SAS  off. 

The  resesrch  reported  in  this  psper  stteapts  to  vslidste  the  spprcisch 
used  to  investigste  the  shove  problea.  Additionslly*  the  use  of  the  optiasl 
control  pilot  aodel  to  deteraine  when  chsnges  in  the  intemsl  aodel  of  the 
pilot  occur  is  investigsted.  The  aethod  used  to  perfora  the  snslysis  is  s 
hypothesis  testing  scheae  developed  in  [7]  snd  [8]  snd  outlined  in  the  psper. 
For  s finite  nuaber  of  pilot  aodels,  esch  with  s different  hypothesized  in- 
temsl aodel  of  the  sircrsft,  the  h3^othesis  testing  scheae  determines  the 
relstive  probsbility  thst  esch  pilot  aodel  best  astches  recorded  pilot  dsts. 
The  chsnges  in  probsbility  give  sn  indicstion  of  the  pilot's  sctusl  sdsptive 
control  procedure. 

The  pilot  dsts  used  in  the  hypothesis  testing  scheae  is  obtsined 
from  one  NASA  Lsngley  pursuit-trscking  siaulstioo  using  their  Differentisl 
Msneuvering  Siaulstor  (DHS).  The  DHS  consists  of  sn  enclosed  heaisphericsl 
screen  within  which  s pilot  sits  in  s cockpit  aock-up.  The  pilot  views  s 
computer-controlled  displsy  of  s trscking  situstion  on  the  screen.  The  pilot 
generstes  control  coaasnds  which  drive  the  nonlinesr  computer  aodel  of  the 
sircrsft.  The  computer  portrsys  the  resulting  sircrsft  motions  on  the  screen 
ss  lewed  by  the  pilot. 

The  pilot  model  hypothesis  testing  scheae  discussed  in  the  psper  is 
very  general  ar ^ is  not  restricted  to  investigsting  situstions  idiere  the 
pilot  aodel  s intemsl  aodel  varies.  Any  situstion  in  which  there  is  more 
than  one  choice  for  s pilot  aodel  psrsaeter  csn  be  tested  to  deteraine  which 


*Tbe  stability  augmentation  systea  (SAS)  is  off  snd  so  sileron- rudder  inter- 
connect systea  (ARI)  is  not  operating. 
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pilot  aodel  best  autches  .oe  data.  Th<s  capability  is  also  deaoastrated  in 
this  paper  using  differet.  choices  for  tue  optiaal  control  pilot  aodel's 
cost  function  quadratic  weights. 


OPTIMAL  CONTROL  PILOT  MODEL 

This  section  briefly  reviews  the  elements  of  the  optical  control 
pilot  model  to  be  used  in  hypothesis  testing.  The  optimal  control  pilot 
model  for  which  detailed  mathematical  development  ca*.  ;.^e  found  in  [5]  is 
based  on  the  premise  that  a motivated,  well*trained  human  controls  a system 
optimally.  To  construct  the  pilot  model,  the  assumptions  needed  to  specify 
an  optimal  controller  are  formulated,  then  modified  to  reflect  basic  human 
characteristics  and  limitations.  The  hypothesis  testing  scheme  requires  an 
analytic  pilot  model,  hence,  the  pure  time  delay  in  the  optimal  contrcl  model 
representing  the  human’s  lamped  time  delay  is  replaced  by  its  Fade  approxi* 
mation.  The  straightforward  solution  for  the  optimal  control  pilot  model 
with  the  Fade  approximation  is  given  in  [9].  A block  diagram  is  shown  in 
Fig.  1.  The  mathematical  representation  is 
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The  n-vector,  Ax(t)  in  Fig.  1,  represents  the  perturbation  aircraft  dynamics, 
aircraft  sas  states,  tracking  error  states,  and  target  states  for  which  a 
more  detailed  discussion  is  given  later.  The  aircraft’s  stick  inputs  are 
represeuced  by  the  m*vector  Au(t);  w(t)  represents  white  Gaussian  noise  dis- 
turbances affecting  the  aircraft  model  dynamics  as  perceived  by  the  pilot. 

The  pilot’s  observations,  Ay(t),  are  degraded  by  zero  mean  %rhite  Gaussian 
noise,  Ay  (t),  then  processed  by  a lead-lag  network  which  is  a Fade  approxi- 
mation to^the  pilot  time  delay.  The  resulting  signal  is  tae  measurement 
vector  for  the  pilot  model's  Kalman  filter  which  generates  a best  estimate 
(AXp  in  (1))  of  the  states  controls,  and  lagged  observation  states.  The 
state  estimate  component  of  Ax^  is  multiplied  by  the  pilot  model's  state 

feedback  matrix,  C,  to  form  the  pilot  model's  internal  control  command,  Au^(t). 
A special  quadratic  cost  functional  is  used  to  find  the  linear-optimal  regula- 
tor gam  C.  The  command  is  corrupted  with  additive,  zero-mean  white,  Gaussian 
noise.  Ay  (t)  which  together  fore  the  input  to  the  neuromuscular  dynamics  model 
which  represents  the  human’s  neuromotor  bandwidth  limitation.  The  output  is 
the  pilot  model’s  aircraft  control,  Au(t)  which  drives  the  aircraft  model’s 
control  actuators.  The  matrix,  K in  Tl),  is  the  pilot  OK>del’s  Kalman  filter 
gain.  The  filter  gain,  K,  depends  upon  input  signal  levels,  neuromotor  noise 
levels,  and  observation  noise  levels;  the  latter  are  related  to  the  former  by 
constant  noise-to-signal  ratios.  The  matrices  K and  C are  determined  by  solv- 
ing Riccati  equations  which  depend  on  the  pilot’s  internal  description  of  the 
aircraft.  The  pilot  model  is  unadapted  when  the  internal  model  description  of 
the  aircraft  used  to  determine  the  pilot  model  is  not  the  same  as  the  Mthe- 
matical  model  of  the  aircraft  at  the  flight  condition  under  investigation. 
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Figure  1 Block  Diegraa  of  the  Pilot  Ho<lel  Conteiaiag 
the  Fade  Approxiauition  to  Pure  Time  Delay 


la  order  to  use  (1)  in  hypothesis  testing,  a discrete  tia»  repre- 
sentation is  required.  Assuaing  that  a saaipling  interval,  At,  is  chosen 
small  enough  so  that  Ay  is  essentially  constant  over  the  interval,  the  dis- 
crete representation  of  the  pilot  model  is 


^ '■pH  ^4.  * ^k 


where 


^ — e 

PM 
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e dt  K„ 


r = r 

’ ' PM  "'PM 

= |Au^,  Az^l  ; = (0  -K^  I] 

_ Fp^t 

ElAw^Aw,^}  = Wp„  = r e e dt 


(2) 
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The  Mtrix  is  the  systea  outrix  io  (1)  while  Qp^ 
the  noise  vector  driving  the  dynsaics  in  (1). 


IS 


the  covariance  of 


HYPOTHESIS  TESTING 

The  hypothesis  testing  philosophy  for  investigating  pilot  control 
adaptation  in  flight  is  to  construct  a nuaber  of  pilot  aodels,  each  using 
different  internal  sK>dels,  and  then  determine  which  pilot  model  best  repre* 
sents  the  actual  pilot  control  behavior.  The  hypothesis  testing  procedure, 
illustrated  in  Fig.  2,  is  based  on  a aodel  structure  identification  algorithsi 
(see  [7]  and  [8])  modified  to  allow  for  changes  in  the  true  hypothesis. 


Figure  2 Kalman  Filter  Approach  to  Pilot 

Control  Strategy  Hypothesis  Testing 

The  notation  used  in  the  figure  is  as  follows: 

^u  , : measured  value  of  pilot  perturbation  control  at  t. 

, K K 

measured  values  of  perturbation  states  assumed  observed  by 
the  pilot 
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one-step  predicted  value  of  ^ . based  upon  {6u 

* * tb  '*•  ^ 

k-1^  » • • • ^ pilot  Bodel  Kalaao  filter 

one-step  predicted  residual  at  the  step  for  the  i^  pilot 
SK>del  Kalaan  filter 

probability  that  the  i^  pilot  aodel  is  best,  based  iq>oo 
knowledge  of 


Hatheaatically,  the  hypothesis  testing  scheme  is  iapleaented  by 
viewing  each  pilot  nodel  represented  in  (2)  as  a dynaaic  systes  whose  input 
IS  the  pilot  observation  vector.  Ay. , with  process  noise,  , and  whose 
neasureaent  output  vector  is  the  actual  Measured  pilot  control  (a>^l)  vector, 

^ 0 0]  ^ (6) 


y is  a zero-aean  gaussian  aeasureaent  noise  with  covariance  V.  The  i^ 

^ th 

pilot  Model  Kalaun  filter  shown  in  Fig.  2 using  the  i pilot  aodel  as  the 

plant  and  the  control  aeasureaents  as  the  observation  vector  is  constructed 

as 
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P^f)  = [I  -Kj  [I  0 0]]  P^-) 


(7) 

(8) 

(9) 

(10) 
(11) 


In  this  application,  the  above  Kalaan  filter  is  assuaed  to  be  in  steady  state. 
If  the  pilot  aodel  is  correct,  the  filter  residuals 

^ik  = ^.k  • ^k^-^  (^2) 

are  a zero-aean  white  gaussian  noise  sequence  with  covariance 
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+ V = 


If  the  rilot  model  is  Dot  correct,  then  ouy  not  be  a white  gaussian 

noise  sequence  and  does  not  satisfy  (13).  The  pilot  model  Kalmmn  filter 
just  described  is  not  to  be  confused  with  the  internal  Kalman  filter  in  the 
pilot  model. 

For  Qotational  purposes,  let 

"k = ^.k' 

Applying  Bayes*  rule,  it  is  shown  in  [8]  and  [9]  that  one  can  write: 


ElirJoi'J)  ■ II  0 0)  P*(-) 


i=l 


(15) 


Using  the  fact  that  Aw  is  assusked  to  be  a zero*mean  gaussian  sequence,  along 

with  the  assumption  that  the  Kalman  filter  state  vector  [Au  (•), 

T T •”  •rt 

Az  (•)]  is  also  gaussian,  it  follows  that 


(2n)*^^ldet 


(16) 


At  each  time  interval,  the  measured  pilot  control  is  used  to  compute  the 
residual  in  (12).  The  residual  and  (13)  are  used  to  compute  the  probabili  ty 
in  (16).  The  probability  is  used  in  (15)  to  recursively  update  the 
probability  that  pi] it  model  i best  matches  the  data.  The  residual  and  meas- 
ured values  of  states  assumed  observed  by  the  pilot  are  used  to  update  the 
Kalman  filter  in  (7)  and  (8)  and  the  process  is  repeated  with  the  next  con- 
trol measurement. 

The  solution  to  the  problem  of  computing  the  P„  (k)  when  the  true 

n , 1 

hypothesis  changes  with  time  is  given  in  1)^1  • Under  certain  simplifying 

assumptions  it  can  be  shown  that  the  solution  requires  N'"  parallel  filters 
to  discriminate  between  the  N possible  hypothesis  at  any  given  time.  Since 
this  may  impose  an  excessive  computational  burden,  an  efficient  suboptimal 
approach  to  the  problem  is  developed  in  [8].  The  suboptimal  approach  is 
nearly  optimal  in  situations  where  the  probability  of  switching  hypotheses 
at  any  given  time  is  low.  The  suboptimal  approach  is  derived  by  noting  that 
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if  uhe  pilot  iiodel  is  true  then  the  recursive  cslculstion  in  (15)  csuses 
Pjj  ^ to  approach  1.  If  Pjj  ^ should  equal  one,  it  will  remain  ^trapped”  at 

one  regardless  of  changes  in  the  pilot's  control  strategy.  To  prevent  this, 
each  probability  is  checked  at  each  time  instant  to  determine  if  it  has  fallen 
below  some  minimum  value  e.  If  any  probabilities  are  smaller  than  e,  they 
are  reset  to  c and  the  other  probabilities  are  suitably  modified  so  that 
they  all  sum  *"0  one.  This  procedure  can  be  implemented  with  only  N parallel 
filters.  Results  presented  later  in  this  paper,  using  e^.05,  indicate  that 
this  suboptima 1 procedure  is  effective  in  detecting  changes  in  the  true 
hypothesis. 

FXIGHT  TEST  SELECTION 

The  simulated  flight  test  selected  for  study  in  a wind-up  turn  track- 
ing task  implemented  on  the  NASA-Langley  Differential  Maneuvering  Simulator 
(DMS).  The  pilot  is  instructed  to  track  a target  aircraft  which  is  displayed 
on  a large  hemi-spherical  screen,  within  which  the  cockpit  is  mounted.  A 
sky-earth  representation  is  also  displayed.  The  target  aircraft's  trajectory 
is  prestored.  There  are  no  intentional  disturbances  affecting  either  the 
target  aircraft  or  the  piloted  aircraft,  although  the  prestored  target  tra- 
jectory exhibits  rapid  and  continuous  maneuvering.  The  pilot  is  flying  a 
complete  nonlinear  computer  mod«»l  of  a high  performance  fighter. 

The  pilot  is  instructed  not  to  use  rudder  pedals.  Lateral-direc- 
tional control  by  the  pilot  is  accomplished  using  only  lateral  stick.  The 
simulation  is  performed  with  the  pitch  and  yaw  SAS  operational,  although  the 
roll  Command  Augmentation  System  (CAS)  is  off.  The  yas  SAS  iiq>rove8  the 
lateral-directional  stability  of  the  aircraft  at  high  angles  of  attack.  This 
means  that  the  stability  boundaries  of  the  bare-aircraft  determined  in  [5] 
and  [6]  cannot  be  used  directly  to  evaluate  pilot  performance  and  the  perform- 
ance of  the  hypothesis  testing  scheow.  The  SAS  states  also  have  to  be  in- 
cluded in  the  aircraft  model  increasing  the  dimension  of  the  problem. 

The  view  throu^^h  the  cockpit  which  is  useful  in  constructing  the 
tracking  error  equations  r.hown  in  Fig.  3.  The  vertical  and  lateral  com- 
ponents of  tracking  error  are  c and  e , respectively,  which  the  pilot  can 
directly  perceive.  The  difference  between  the  pilot's  fixed  pipper  and  the 
aircraft's  velocity  vector  are  the  angle  of  attack,  ot,  and  sideslip  angle, 

3,  which  the  pilot  cannot  directly  perceive.  The  difference  between  the 
aircraft's  stability-axis  roll  angle,  ^ , and  the  stability-axis  roll  angle 
of  the  target,  is  60^  and  is  directly  perceived  by  the  pilot.  The  pilot 

does  not  have  any  motion  cues.  Any  computational  time  delay  in  the  DHS  be- 
tween the  pilot's  stick  movement  and  changes  on  the  screen  is  assumed  to  be 
small  and  is  not  modeled  in  the  analysis.  A complete  record  of  the  aircraft 
state  and  control  histories  is  recorded  at  32  samples  per  second.  Addition- 
ally, the  tracking  angles  and  range  to  the  target  are  recorded,  and  target 
motion  is  inferred  from  these  measurements.  The  aircraft  measurements  are 
computer  generated  and  together  with  the  pilot's  control  movements  have  vir- 
tually no  measureme.it  noise.  This  implies  that  V in  (6)  is  zero  and  the 
process  noise  in  (1)  contains  no  contribution  from  possible  measurement  noise 
errors  in  Ay. 

The  wind-up  turn  tracking  task  lasted  90  sec.  At  50  sec  into  the 
run,  the  pilot  is  forced  to  saturate  lateral  stick  almost  continuously  in 
order  to  continue  tracking.  Because  of  this,  only  the  first  40  sec  of  the 
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Figure  3 Pursuit-Tracking  Task  View  Through  the  Cockpit 


run  are  analyzed.  Only  the  lateral-directional  dynaaics  are  investigated 
with  the  pilot  aodel. 

Variations  of  angle  of  attack  are  sho%m  in  Fig.  4 for  the  40  ^ .c 
interval.  The  aircraft  remains  at  a low  angle  of  attack  flight  condil.ion 
for  the  first  10  seconds,  then  the  aircraft  angle  of  attack  increases  to  a 
aaxiaua  of  21  deg  as  toe  aircraft  enters  the  wind-up  turn.  Using  the  air- 
craft time  histories  ihom  in  Fig.  4.  the  pilot  aodel  hypothesis  test  can  be 
well  posed:  when  the  angle  of  attack  of  the  aircraft  increases  beyond  5 deg, 
significantly  changing  the  aircraft’s  dynaai'^s,  does  the  pilot's  control 
behavior  remain  fixed  to  a 5 deg  ot^  strategy  or  does  the  pilOw  change  his 
strategy  to  match  the  aircraft’s  ^uanging  dynamics?  To  begin  answering  this 
question,  the  model  of  the  aircraf t-target  dynamics  and  the  pilot  model  param*' 
eters  are  presented  in  the  next  tvo  sections,  respectively. 


TRACKING  TASK  MODEL 

The  tracking  task  model  is  composed  of  four  components  at  the  adapta- 
tion point;  the  linearized  dynamics  of  the  subject  aircraft,  the  SAS  dynamics, 
the  linearized  tracking  error  dynamics,  and  the  linearized  target  model.  A 
derivation  of  the  models  is  preswznted  in  [9].  A summarv  of  all  the  linearize.d 
models  is  given  in  Table  1. 

The  tracking  task  model  is  typical  of  air-to-air  combat  model?  115 
cussed  in  [ll]  ana  [l2].  In  both  referen'  :s  the  aircraft  models  ai«. 
fied  linear  time-invariant  longitudinal  dynamics  implemented  or  ^ . 

Simple  target  dynamics  art  used  both  in  the  simulation  «.ae  model.  ic 
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Figure  4 Angle  Attack  Tiae  Histo/y 


this  esse,  the  ^ of  the  complete  target  aircraft  aodel  (another  fighter 
aircraft)  in  the  tracking  task  aodel  is  infeasible.  An  approaiaatlon  vhereby 
ocly  the  target  aircraft  states  Ap  - and  A#  . are  aodeled  in  the  tracking 
task  Bodel  is  aade.  Ucaodeled  target  dynaaxes  are  luaped  into  a zero  aean 
saussi'^sn  noise  tern  Am«  which  drives  **  shown  ^n  4,  Table  1.  The  iapli* 

cation  is  that  the  huaan  has  no  explicit^ inf oraation  about  the  dynaaics  driving 
Ap^^  and  also  regards  the  effect  as  white  noise.  The  paraaeters  in  the  siap- 

lified  t-arget  model  in  Table  1 are  determined  by  identification  based  on 
measured  values  of  discussed  in  [9].  The  value.*  used  are  a^s*4.4, 

a^=1.6  and  E{w^}=4.0  (deg^/scc^). 


PURSUIT  TRACKING  PILOT  MODEL  PARAMETERS 

The  parameters  yet  to  be  specified  at  this  point  are  the  pilot  observa* 
tioas.  the  flight  conditions,  a choice  of  tLe  pilot  model's  quadratic  state 
weighting  matrix  and  the  standard  paraaeters  of  the  pilot  model.  The  flight 
conditions  are  a priori  specifications  of  aircraft*target  dynaaics  along  the 
maneuver  under  investigation  at  which  the  pilot  aay  fonsulate  a control 
strategy. 

From  Fig.  3,  the  pilo.  observations  are  the  lateral  error,  Ac  , and 
the  stability-axis  r^l  angle  error,  Aot  As  is  customary  in  the  optlf^l 
control  model,  the  rates  of  these  states  ar^'  also  assumed  observed.  From 
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LINEARITTJ)  tracking  MODEL  DYNAMICS 
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Fig.  H,  three  Tlight  conditioot  which  priMnly  differ  in  angle  of  attacn 
are  chosen  to  fora  the  pAlot'g  internal  aodel:  low  (a  ^1.2  deg),  Mdiua, 
(0^=9. 3 deg)  and  high  (a^=19.2  deg). 

The  quadratic  cost  function  weights  used  to  construct  the  pilot 
•odel  quantify  the  pilot's  tradeoff  of  tracking  error  and  control  effort. 

High  weights  inply  that  the  pilot  expends  significant  control  effort  in  order 
■iniaize  tracking  error.  He  can  be  said  to  be  a **high-ga\n"  or  "tight*' 
pilot.  On  the  other  hand,  low  quadratic  weights  typify  a "low*gain"  or 
"loose"  piloting  technique,  ^he  specific  values  for  the  state  quadratic 
weights  used  in  ^^e  tests  reported  here  are  given  in  Table  2.  The  tracking 
error  rate  weight  in  the  pilot  Model's  coat  function  is  chosen  to  be  one* 
lourth  of  the  tracking  error  weight,  as  suggested  in  Ref  11.  Based  on  plots 
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of  tb«sc  during  thm  MU«uir«r»  lutural  vtloclty  is  Msigktsd  sad 

▼srlstiotts  rsUisr  tbsn  ▼sristioos  srs  wtigdtsd  la  tbs  cost  fuactisa. 

At  tbs  lov  sod  asdiua  flight  coDditioas  is  Tsbis  2«  s high  wslgbt, 

cost  functiOQ  (2)»  sod  s lov  vsight*  cost  fusction  (1),  srs  spoclfisd.  lbs 
rsst  of  ths  pilot  sodel  psrsastsrs  srs  itssdsrd  (huass  psrcsp'*.iisl  tiat  daisy 
of  0.2  ssc»  DS*'«*oauscuisr  tias  cosstsat  of  0.1  sac,  obsanrstioa  aoisa  to 
sx^Bsl  rstir  vf  *20  db  sad  s «:t*iroaotor  aoisa  to  sigasl  ratio  of  *30  db). 

TABLE  2 

LQUARE  BOOT  OF  PILOT  MODEL  COST  FlllCTIQII  WIGRS 
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0.25 
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1.25 

9.3 
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0.25 

0.25 

10.0 

2.5 

19.5 

1 

0.25 

0.25 

5.0 

1.25 

tbs  rssitUlng  pilot  aodsl  fssdbscb  gala  slsasots  srs  sbom  la  Tsbis 
3.  Tbs  (siss  sxbibit  littls  cbsags  obaa  tbs  cost  fuactioa  cbsagsa  bataaaa  1 
sod  2.  Tbs  pllct  asdsi  ccatrol  galas  at  0^*5. 2 dag  sad  0^*9. 3 dag  srs  soas* 

obits  the  high  Oq  rsrsus  lov  pilot  aodal  gala  srs  slgaifl* 

csotly  diffcrsnt.  Thsss  diffsrsacsi  indicsts  tbs  bypotbssls  ts*  .lag  scbaas 
should  bs  sole  to  asks  s cissr  dscisioo  bstvsao  tbs  high  sad  lov  o^ 
strstsgisi . 


HTPOTUESIS  TESTIBC  RESULTS 

This  ssction  prsssats  tbs  results  froa  ths  bypotbssls  tastlag  scbsas 
in  tvo  forsats.  In  ths  first  forast,  tbs  oas*stsp  pr^lctsd  pilot  aodsl 
control  tias  history  is  overlaid  oa  tbs  actual  pilot's  Istsral  stick  control 
tisa  history.  Ths  closer  these  tvo  trajectories  astch»  tbs  batter  tbs  ladl* 
cation  is  that  ths  sssuswd  pilet  is  correct.  Ths  sscoad  foraat  Is 

coapossd  of  plots  of  ths  probabilities  that  each  pilot  9odal  is  tbs  bast  of 
those  tested.  Ths  first  foraat  gives  an  absolute  indicsts  of  pilot  aodsl 
perfcmance  vhils  ths  second  foraat  gives  a relative  Indication  of  per* 
foraancs  bett^en  the  pilot  aodels. 

lyp^tbesis  testing  procedure  and  the  accoapeaviag  Calaar  filter 
require  pe.urtation  variables,  Au  . and  Ay.,  but  only  total  valusi.  u . 
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TABLE  3 
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and.  V,  , are  available  froa  the  flight  tests.  A high*pass  filter  (vash*out 
filter!  was  initially  tested  with  the  procedure.  It  was  determined  that  the 
pilot  Manages  to  keep  5#^,  and  5^  near  the  zero  axis  and  the  high  pass 

filter  proved  to  be  unnecessary.  A high*pass  filter  would  be  necessary  for 
lovestigatinf  the  loaf  tudiaal  axis  with  the  hypothesis  testing  procedure. 

Initial  trials  of  the  hypothesis  testing  calculation  procedure  with 
the  piloted  data  indicated  a severe  Mismatch  occurs  between  the  Kalman  filter's 
estimate  of  its  output  error  covariance,  S in  (13),  and  the  actual  output 
error  covariance,  which  is  calculated  as 

^ = i H7) 


T’jz  a large  number  of  data  points  (k  is  large  in  (17)),  the  matrix  S.  should 
approach  S for  a linear,  tiM- invariant  system.  The  mismatc::  ocqurs'^because 
the  pilot's  internal  model  of  the  target  driving  covariance,  E{6^],  appears 

to  differ  continuously  frn'^  the  actual  constact  value  discussed  previously. 
The  mismatch  also  arises  due  to  the  existence  oi  musodeled  dynamics,  non* 
linearities,  and  due  to  the  time*varying  nature  of  the  actual  piloted  simu* 
lation . 


To  resolve  this  mismatch,  a ^ ■^'>Ie  approach  is  used  whereby  an  esti- 
mate cf  S,  based  on  (17),  is  used  in  the  hypothesis  testing  scheme.  The 
usefulness  of  this  modification  is  confirmed  by  the  agreement  observed  in 
the  next  paragraphs  between  the  hypothesis  testing  results  and  the  pilot 
control  trajectory  comparisons. 

Comparisons  of  the  actual  pilot  control  time  history  to  th-  p»lot 
model  predictions  are  illustrated  m ti$.  5.  The  low  pilot  mode  wivh 
normal  oiloting  technique  shown  in  Fig  5a  matches  the  actual  pilot's 
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responses  quite  well,  except  perhaps  in  the  regions  circled.  The  low 
pilot  aodel  with  especially  "tight**  piloting  technique  (Fig.  5b)  exhibits  no 
discernable  difference  froa  the  low  noainal  pilot  aodel.  The  aediua 
pilot  aodel  (Fig.  5c)  does  not  natch  the  pilot  control  inputs  as  well  as  the 
low  pilot  aodel  except  perhaps  within  the  circled  regions.  The  high 
pilot^aodel  does  a poor  job  of  predicting  pilot  behavior  even  in  high 
flight.  This  pilot  does  not  significantly  adapt  his  control  strategy  tc 
natch  the  changes  in  aircraft  dynaaics.  Note  that  no  conlusion  regarding 
quadratic  weight  ("tight**  or  **nomal**  control  effort*tracking  error  trade* 
off')  can  be  aade  based  on  visual  inspection  of  these  figures.  The  reasonable 
natch  in  Fig.  5a  tends  to  justify  the  aodeling  siaplif ications  used  in  the 
analysis  and  the  attes^>t  to  capture  huaan  control  behavior  using  the  optimal 
control  aodel.  The  fact  that  different  assumptions  in  the  construction  of 
the  nodel  produce  a poor  natch  as  shown  in  Fig.  5d  adds  further  credence  to 
these  conclusions. 

The  hypothesis  testing  pilot  aodel  probabilities  are  shown  in  Fig. 

0.  Recall  that  the  results  take  the  fora  of  a probability  for  each  of  the 
hypothesized  pilot  aodels;  the  sua  of  the  probabilities  of  all  hypotheses  in 
a given  test  is  equal  to  one.  The  h3^othesis  testing  algorithm  is  allowed 
to  choose  between  the  low  a.,  nediua  and  high  pilot  aodels  with  nominal 
quadratic  weight.  The  low  aodel  best  matches  the  pilot's  responses  except 
in  the  circled  regions.  The  nediua  a.  pilot  aodel  best  matches  the  pilot's 
response  in  the  circled  regions.  At  no  time  does  ihe  high  aodel  predict 
the  actual  pilot's  behavior,  even  when  the  aircraft  really  is  in  a high 
flight  condition.  The  hypothesis  testing  result  confirms  the  qualitative 
analysis  of  the  control  time  histories. 

Choice  of  pilot  tracking  error  control  effort  trade*off  (quadratic 
we*.ght  level)  could  not  be  aade  froa  a visual  examination  of  the  control 
responses,  but  the  hypothesis  testing  algorithm  clear^  indicates  in  Fig.  7 
that  the  "normal**  weights  give  a much  better  fit  to  the  data  than  the  **high** 
weights.  This  indicates  that  the  **hi  h*gain**  or  "tight**  pilot  aodel  is  not 
as  good  a representation  of  what  the  pilot  actually  did  in  this  test  as  is 
the  normal  or  "low-gain"  pilot  aodel  values. 


SUMMARY 


This  paper  presents  a aethod  for  comparing  actual  pilot  control 
actions  in  the  tiae  domain  with  pilot  aodel  predictions.  A modified  hypo* 
thesis  testing  scheme  coabined  with  the  linear  optimal  control  pilot  aodel 
IS  developed  that  can  be  used  to  analyze  nonlinear  piloted  aircraft  data. 
Actual  data  from  the  NASA  Differential  Maneuvering  Siaulator  of  a pilot  in 
pursuit-tracking  of  an  aircraft  target  is  analyzed  with  the  hypothesis  test- 
ing scheme  The  priamry  result  is  that  for  the  lateral  directional  control 
channel,  the  pilot,  throughout  aost  of  the  simulation,  did  not  change  his 
'nternal  aodel  of  the  aircraft's  dynamics  froa  a low  angle  of  attack  flight 
condition  to  another  model  better  rcpre  entative  of  the  aircraft  dynac'cs. 
This  observation  validates  the  approach  used  in  (5]  and  [6]  where  a priori 
predictions  of  pi  lot -a i rc raft  instabilities  are  aade  using  a oonadapting 
pilot  model  It  is  suggested  that  the  reason  the  pilot  may  not  choose  to 
continuallv  adipt  is  as  ^iven  in  (h):  the  niniaua  control  effort  strategy. 

To  adapt  to  h^gh  or^ , the  pilot  would  have  to  increase  his  control  effort  by 
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b)  Low  Oq  Pilot  Model  With  High  Quadratic  Cost  Weights 

Figure  5 Coaparisoo  of  Actual  and  Predicted 
Pilot  Controls 
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d)  High  Pilot  Model 

Figure  5 Conparison  of  Actual  and  Predicted  Pilot 
Controls  (Continued) 
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Figure  6 Pilot  Model  Probabilities 
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Figure  7 Pilot  rl  iel  Probabilities  for  Two  Pilot  Models  at 
GT^  5 with  Different  Quadratic  Weights 
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subjectively  increasing  his  feedback  gain  as  shown  in  Table  3.  Even  when 
the  internal  aircraft  aodel  xn  the  pilot  aodel  real ins  at  the  one  preferred 
by  the  pilot,  the  hypothesis  testing  schese  shows  in  Fig.  7 that  the  pilo^ 
does  not,  at  any  tine,  aodestly  increase  his  feedoack  gain  for  the  flight 
condition  to  which  he  is  adapted. 

These  results  dencnstrate  the  feasibility  and  usefulness  of  the 
hypothesis  testing  approach  using  one  piloted  trajectory.  It  is  apparent 
that  analysis  of  nany  trajectories,  with  an  inproved  target  dynamics  nodel* 
ing  effort,  as  in  [13],  is  necessary  before  sore  general  conclusions  can  be 
■ade. 
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SaBJECTIVE  SCALING  OF  MENTAL  WORKLOAD 
IN  A MDLTI-TASK  ENVIRONMENT 


Bahman  Daryanion 

H.I.T. 


INTRODUCTION 

This  paper  reports  and  examines  the  results  of  a mental 
workload  (MWL)  experiment  which  was  carried  out  in  a simulated 
multi-task  environment.  The  objective  of  the  experiment  was  to 
develope  and  examine  a method  that  would  qualitatively  and 
quantitatively  identify  those  factors  in  a multi-task  environment 
that  contribute  to  the  operators*  "sense"  of  mental  workload. 

In  the  experiment,  the  sub.iective  judgment  as  conscious  experience 
of  mental  effort  was  decided  to  be  the  appropriate  method  of 
measurement. 

Thurstone's  law  of  comparative  judgment  was  employed  in 
order  to  construct  interval  scales  of  subjective  mental  workload 
from  paired  comparisons  data. 

An  experimental  paradigm  (Simulated  Multi-Task  Decision- 
Making  Environment)  developed  by  Tulga  (l)t  was  employed  in  this 
work  to  represent  the  ideal  experimentally  controlled  environment 
in  which  subjects  (human  operators)  were  asked  to  "attend"  to 
different  cases  of  Tulga* s decision-making  tasks. 

Through  various  statistical  analyses  it  was  found  that,  in 
general,  a lower  nvunber  of  te^sKs-to-be-processed  per  unit  time  (a 
condition  aissociated  with  loi’^er  interarrival  times),  results  in 
a lower  mental  workload,  a higher  consistency  of  judgments  within 
a subject,  a higher  degree  of  agreement  among  the  subjects,  and 
larger  distances  between  the  cases  on  the  Thurstone  scale  of 
subjective  mental  workload. 

The  overall  method  employed  in  this  experiment  brings  into 
notice  the  effects  of  various  control  varJ  ables  and  their  inter- 
actions, and  the  different  characteristics  of  the  sub.lects  on  the 
variation  of  subjective  mental  workload. 

THE  EXPERUdENT 

A multi-task  decision-making  sitration  in  Tulga's 
experimental  paradigm  is  characterized  by  a number  of  blocks 
(tasks)  of  differing  dimensions  simultaneously  displayed  on  the 
CRT  (Figure  1),  randomly  appearing  and  moving  to  the  right 
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towards  a deadline,  after  which  they  disappear.  Each  block  is 
characterized  by  it?  ‘•importance"  (indicated  by  the  height  of 
each  block),  and  the  operator's  "productivity"  (tne  rate  at 
which  the  width  of  a block  is  decreased  through  the  action  of 
the  operator) . 

The  subject  "attends"  to  these  tasks  c e at  a time  by 
holding  the  cursor  of  a data-tablet  to  the  right  of  the  block 
(Figure  2),  when  thus  attended  the  width  of  a block  decreases 
at  a constant  rate.  The  subject  is  asked  to  maximize  his/her 
total  value  gained,  which  is  the  sum  of  the  raductirn  in  aresus 
of  all  blocks  attended  to  by  hii^/her,  i.e.  the  t.-tal  area 
diminished. 

Blocks  appear  randomly  with  Poisson  arrival  and  ’e  at 
differing  speeds  towards  the  deadline.  Height  or  "impv;r>-ance" 
of  a clock  C2U1  be  thought  of  as  the  "value  density"  of  the  tarir: 
which  indicates  the  benefit  accrued  per  unit  time  the  operator 
acts  on  it.  Value  can  then  be  earned  as  ’’he  time  integral  of 
value  densities  of  tasks  acted  upon.  The  value  density  for  each 
case  has  a recteuigiilar  probability  density  distribution  of  1.0 
unit/ time. 

Thb  explicit  parameters  that  differ  for  each  case  (trial) 
are  speed  "S",  productivity  "P",  and  interarrival  time  "T"  of 
the  blocks  (tasks).  For  three  levels  of  each,  a factorial, 
experiment  requires  27  cases  where, 

Task  Speeds  Sj^»0.2,  82*0.4,  S^»0  8 units/sec 

Operator  Productivities  t Pj^=0.4,  P2*0.8,  Fyl.S  units/sec 

Interarrival  times  Tj^*3>0,  T2*6.0,  T^*12  seconds. 

In  short,  the  operator  monitors  the  arrival  of  different 
tasks,  evaluates  the  tasks,  chooses  one,  and  acts  '>n  it  before 
it  hits  the  deadline. 

One  female  subject  (operator  1),  and  two  male  subjects 
(operators  2 and  3),  were  invited  to  participate  in  the 
experiment.  After  initial  stages  of  training  each  subject  was 
^lsked  to  "attend"  to  multi-task  decision-making  cases  for  100 
seconds  eachi  and  then  compare  the  cases  on  a pair-wise  basis  in 
order  to  give  a subjective  assessment  of  the  relative  mental 
workload  induced  by  the  pair. 

Cases  were  presented  in  a random  fashion.  Care  was  taken 
to  avoid  any  noticable  order  in  the  presentation  of  the  cases. 
Most  of  the  pairs  were  presented  more  thfin  once.  For  each  subject 
the  experiment  was  carried  oot  in  a period  of  5wo  to  three  weeks 
for  a total  of  35“45  hours . 

The  paired  comparisons  judgments  cf  a subject  resulted  in 
one  of  the  three  categories  of  respons.;si 

A-  Th-  '^'jc^t  was  cer  wain  that  the  mental  wc'i*x:load 

wd  by  one  cf  the  cases  was  greater  than  the  other. 
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B-  The  subject  thought  that  probably  the  mental  workload 
Induced  by  one  of  the  cases  was  greater  than  the 
other. 

C-  The  subject  was  unable  to  make  a relative  judgment 
between  the  cases. 

THE  SCAUNG  METHOD 

The  "I'lw  of  comparative  judgment",  which  is  based  on 
Ihurstone*'  .udgment  scsJdng  model,  provides  the  necessary 
e 'nplifyi:;^  assumptions  and  the  set  of  equations  that  transform 
tne  paired  comparison  data  into  the  scale  values  of  mental 
wraiJ.oad  (refn's  2,3,^)* 

Thurstone's  model  assumes  that  the  psychological  distance 
between  t;.w  stimuli  is  proportional  to  the  nonud  deviate  trans- 
form of  the  proportion  of  tines  a difference  between  the  stimuli 
is  noticed.  The  distance  between  a pair  of  stimuli  is  highest  if 
one  is  always  judged  to  be  greater  than  the  other,  and  zero  if 
they  are  judged  to  be  equal.  Therefore,  the  subjective  scale  of 
Thurstone  is  bsised  upon  the  degree  of  confusion  of  the  subject 
in  the  jud^ent  of  relative  intensity  of  the  psychological 
attribute  in  a pair  of  stimuli. 

Thurstone’s  Judgment  Scaling  Model 

Thurstone  postulated  that  for  any  given  attribute  (e.g., 
ment2d  workload)  of  a series  of  stimuli  (e.g.,  decision  tasks) 
there  exist  a "psychological  continuum"  associated  with  that 
attribute.  A subject  presented  with  a series  of  stimuli  would 
react  "discriminally"  with  respect  to  the  given  attribute  (e.g., 
the  subject  would  discriminate  between  the  different  levels  of 
mental  workload  associated  with  a series  of  decision  tasks). 

The  process  by  which  the  subject  identifies  the  attribute  and 
reacts  discriminally  to  it  is  called  a "uiscriminal  process"; 
and  each  of  the  "discriminal  responses"  associated  with  a 
discriminal  process  heis  a value  on  the  psychological  continuum 
associated  vrith  that  attribute.  It  is  assumed  that  due  to  the 
stochastic  nature  (noise  generation,  momentary  fluctuation)  of 
the  organs  of  the  human  mind  (sensation  and  cognition),  i.e.  of 
the  discriminal  processes,  the  discriminal  response  associated 
with  a given  attribute  of  a stimulus  could  be  thought  of  as  having 
a frequency  distribution  on  the  psychological  continuum. 
Furthermore,  it  is  postulatid  that  the  frequencies  with  which  the 
discriminal  responses  are  associated  have  the  form  of  a normal 
distribution. 

In  a normal  frequency  distribution  the  modal,  mean,  and  the 
mode  coincide.  A possible  choice  for  the  "scale  value"  of  the 
attribute  <pn  psychological  continuvm  is  the  "modal  discriminal 
response  ", 

Figure  3 provides  examples  of  discriminal  responses  on  a 
psychological  continuum  for  four  stimuli.  Note  that  the  modal 


176 


discriminal  responses  S^t  and  Sk  and  the  respective 
discriminal  dispertiona‘*‘vary  for  each  stimulus* 

It  is  assumed  that  the  subject  can  not  directly  report 
the  modal  values  of  the  discriminal  responses  or  their  dispersions 
on  the  psychological  continuum*  However*  presximably  he  can  judge 
and  report  relations  among  stimuli  (e«g**  judgment  of  relative 
orders ) . 

The  Law  of  Comparative  Judgment 

The  law  of  comparative  judgment  is  a set  of  equations 
relating  the  scale  values  and  discriminal  dispersions  of  a set 
of  stimuli  on  the  psychological  continuum  to  the  proportion  of 
times  any  stimulus  is  judged  greater  than  the  others  for  a given 
attribute. 

When  a pair  of  stimuli  is  presented  to  a subject  the 
difference  between  two  discriminal  responses  (discriminal 
differences*  dj  - d,(  ) * should  also  form  a normal  distribution* 
The  mean  of  this  distribution  is  equal  to  the  difference  in 
scale  values  of  the  two  stimuli.  The  standard  deviation  of 
differences  is  computed  from 

^dj-d^“  ^ ^ j ^ ^ ^j  (Eq*l) 

where  rj)^  is  the  correlation  between  momentary  values  of  dis* 
criminal  responses  associated  with  stimuli  j and  k* 

As  a result  of  Thurstone*s  judgment  model  the  following 
rolation  holds  for  the  difference  in  scale  values  of  the  two 
stimuli  X 

^ • 'jk 

where  (see  Figure  4)*  is  evaluated  from  the  table  of  areas 
under  the  unit  normal  curve*  and  it  is  in  units  of  the  standard 
deviation  of  discriminal  differences. 

Combining  Equations  1 and  2*  the  fimdamental  equation  of  the 
law  of  comparative  judgment  results  t 

- 2'-jk<7-j<rk 

In  general*  for  n stimuli*  there  are  n scale  values*  n dis- 
criminal dispersions*  and  n(n-l)/2  independent  correlations 
which  are  unknown.  Against  these*  there  are  only  n(n-l)/2 
observable  equations  corresponding  to  the  independently  obser- 
vable proportions.  In  order  to  decrease  the  number  of  unknowns 
some  simplifying  assumptions  are  necessary.  It  shotild  be  noted 
that  X*«  is  related  to  the  proportion  of  the  times  stimulus  j 
is  judged  greater  than  stimulus  k. 

A Workable  Set  of  Equations 

Assuming  that  th^  standard  deviation  of  discriminal 
differences  is  constant  and  the  same  for  all  pairs  of  stimuli*  a 
"least  squpre"  solution  results  in  the  following  equation  for 
detemining  the  estimated  scale  values  of  stimuli t 
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n 

(IfJ.  2.  ... 

In  derivation  of  this  equation  it  was  assumed  that  the  origin  of 
the  scale  is  set  at  the  Man  of  the  estimated  scale  vaduea. 
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REDUCTION  OF  THE  DATA 


As  mentioned  before,  the  subjects  judged  the  relative 
greatness  of  mental  workload  for  a pair  of  multi-task  decision- 
making cases,  and  the  verbal  responses  resulted  in  one  of  the 
three  categories  of  A.  B,  or  C. 

By  accumulation  of  these  paired  comparisions  data  verbal 
•esponse  matrices  "R**,  were  constructed  whose  elements  were  one 
of  the  five  possibilities  (certainly  greater,  probably  greater, 
equal,  probably  less,  certainly  less)  for  "relative"  mental 
workload  induced  by  each  pair  of  cases.  Due  to  replication,  as 
shown  in  the  example  of  Figure  5,  some  eleMnts  contained  more 
than  one  response.  The  diagonal  matrices  were  left  blank, 
assuming  that  the  resocnse  of  any  subject  when  a case  is 
compaired  to  itself  would  be  "C".  In  addition,  in  order  to 
indicate  wether  a case  represented  by  a row  induced  more  Mntal 
workload  or  the  one  represented  by  the  column,  the  verbal 
responses  were  added  a or  prefix.  Hence,  the  response 
matrix  of  the  Figure  5 is  skew  symmetric  matrix.  These  verbal 
responses  were  transformed  into  the  frequency  response  form  by 
the  criteria  shown  below  t 


el4 

HMUt  ij 

el4 

ment  ji 

i; 

row 

It 

row 

Category 

Verbal  Response 

column 

i; 

column 

I:  +aij 

i certainly  greater 

4 

0 

than  j 

i probably'  greater 

3 

1 

11;  +bij 

than  j 

III;  cij 

i equal  to  j 

3 

2 

IV;  bij 

i probably  less 

1 

3 

than  j 

i certainly  less 

0 

4 

V;  -aij 

than  j 

Vmrbai  to  Frequency 
Transformation  Criteria 
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The  above  criteria  translates  into  the  following t 

I t Is  equivalent  to  judging  itimulus  i to  be  greater 

than  stimulus  j four  times  in  four  trials. 

II  I Is  equivalent  to  judging  stimulus  i to  be  greater 

than  stimulus  j three  times  in  four  trials. 

III  t Is  equivalent  to  judging  stiatilus  i to  be  greater 

than  stimulus  j twice  in  four  trials. 

IV  I Is  opposite  of  II . 

V I Is  opposite  of  I . 

According  to  this  criteria  the  verbal  response  antrix  of 
Figure  5 is  transformed  into  the  frequency  response  matrix  *P** 
of  Figure  6.  In  tuim,  matrix  "F*  is  transformed  into  the 
proportion  matrix  ”P"  of  Figure  7 by  deviding  each  element  of 
fj^  by  toe  sum  of  fjjj+fjjj.  From  matrix  T",  matrix  "X“  of 
Figure  8 is  constructed  whose  elements  are  equal  to  the  unit 
normal  deviate  corresponding  to  the  element  Pj.  . Flnallyt  by 
substituting  the  values  of  Xi^  in  Equation  4 tne  scale  of 
Figure  9 is  constinicted. 

Figure  10  presents  the  resulting  Thurstonian  scales  of 
subjective  mental  workload  for  each  of  the  subjects. 

ANALYSIS  OF  DATA,  RESULTS.  AND  CONCLUSIONS 

For  the  purpose  of  the  study  of  the  experimental  data  three 
independent  techniques  of  analysis  were  employed < 

i ) Analysis  of  variance,  which  tests  the  significance 
of  the  effects  of  different  variables  of  decision- task 
environment  ( Ti  interarrival  time»  Si  task  speeds:  Pi  produc- 
tivity: 0i  operators)  on  the  variation  of  subjective  mental 
workload . 

ii  ) Analysis  of  agreement  among  the  subjects,  which 
tests  how  well  subjects  agree  among  themselves  in  their  judgments. 

iii)  Analysis  of  transitivity,  which  provides  a basis 
upon  which  the  consistencies  of  the  judgments  of  subjects  are 
compared . 

It  was  found  that  the  interrarival  time  "T"  of  the  tasks 
has  the  most  significant  effect  (among  all  the  control  variables) 
on  the  variation  of  mental  workload  (see  Table  1).  As  could  be 
seen  in  Figure  10,  the  27  cases  are  clustered  into  3 seperate 
groups  corresponding  to  3 levels  of  interarrival  time  "T*.  Based 
on  this  finding,  analyses  of  variance  was  performed  for  each 
level  of  "T".  Results  are  shown  in  Tables  2 to  4. 

Analysis  of  agreement  is  based  on  computing  the  Spearman's 
Rank  Correlation  Coefficients  for  pairs  of  subjects  and  testing 
their  significance  for  the  final  rank  ordered  results.  Also 
included  in  the  analysit  was  the  computation  and  testing  of  the 
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Coefficient  of  Concordance.  Results  are  shown  in  Table  5* 

Analysis  of  transitivity  is  based  on  the  computation  of  the 
number  of  the  inconsistent  triads  for  the  subjects*  responses. 
The  diagram  below  illustrates  the  meaning  of  the  transitivity 
(consistency  of  responses).  Results  are  shown  in  Table  6. 


b 


4 


•*  , 

'•  cta*tte  . * 


* ( .rrau  tfca  • J «*«>»««.  •»  * 

The  following  is  an  overview  of  the  results  of  the  analyses. 
For  a more  detailed  exposition  of  the  results  the  reader  should 
refer  to  Ref.  6. 


The  experimental  environment  and  the  results  of  the 
subjective  judgments  provide  support  for  a conceptual  model  of 
subjective  mental  workload  with  the  following  general  properties i 

- Subjective  mental  workload  is  stochastic  in  nature. 

- Subjective  mental  workload  is  a property  of  the 
environment-operator  interface,  and  it  depends  on  both 
environment  and  operator  characteristics. 

- Subjective  mental  workload  can  be  quantified  on  a 
unidimensional  scale,  as  demonstrated  by  this  work. 

- There  exists  a substantial  degree  of  agreement  among 
subjects  in  their  judgments  of  mental  workload. 

The  following  more  specific  conclusions  can  be  drawn  from 
the  study: 

1-  Among  the  experimentally  controlled  variables  the  inter- 
arrivatL  time  between  tasks  "T",  has  the  most  significauice  effect 
on  the  vauriation  of  subjective  mental  workload.  A longer  inter- 
arrival time,  which  is  associated  with  a lower  number  of  taisks- 
to-be-processed  per  unit  of  time,  results  in  a lower  subjective 
mental  workload. 


2-  In  general,  a lower  number  of  tasks-to-be-processed  per 
unit  time  (a  condition  associated  with  longer  interarrival  times) 
is  aissociated  with  the  following: 

- lower  subjective  mental  workload. 

- higher  degree  of  consistency  (more  transitive  responses) 
within  subjects. 

- better  agreement  among  subjects  on  rank  ordering  of  cases 
with  respect  to  their  associated  mental  workloads. 

- larger  intervals  between  adjacent  cases  on  the  aggregate 
scale  of  subjective  mental  workload  (see  Figure  10). 

3-  Analysis  of  consistency  indicates  a high  degree  of 
transitivity  of  responses  for  the  aggregate  data  except  for  short 
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interarrival  times  of  tasks,  which  supports  the  hypothesis  of 
the  existence  of  a uni dimensional  psychological  continuum 
associated  with  the  attribute  of  subjectiv  ental  workload  for 
medium  and  low  levels  of  mental  workload. 

4-  Absence  of  agreement  aunong  the  subjects  with  reflect  to 
the  ordering  of  the  experimental  cases  according  to  their  mental 
workload,  and  a very  low  degree  of  consistency  (low  transitivity 
of  responses)  at  the  shortest  interarrl/al  time  indicate  that 
either, 

i)  mental  workload  is  a multi dimen:  .cnal  psychological 
attribute  at  high  levels  of  mental  workload;  or, 
ii)  the  difference  between  scale  valx’es  of  mental  workload 
for  cases  become  less  noticeable  (i.e.,  differentiable) 
at  higher  levels  of  mental  workload,  thus  indicating 
the  approach  of  an  upper  threshold  of  mental  workload. 

The  author  accepts  the  second  interpretation. 

5-  Analysis  of  consistency  resulted  in  a higher  degree  of 
transitivity  of  responses  for  the  aggregate  data  than  that  of 
each  indivitual  subjects*  data  except  for  the  short  interarrival 
time;  thus  indicating  that  the  aggregate  scale  of  subjective 
mental  workload  is  a more  reliable  scale  than  the  individual 
scales  of  the  subjects. 

6-  Short  and  mediiom  interarrival  times  are  associated  with 
cases  which  demand  some  degree  of  monitoring  and  decision  madcing, 
whereas  the  long  interarrival  time  is  associated  with  cases  that 
require  little  monitoring  and  decision  making  and  may  even 
provide  f^'^e  times  between  the  appearances  of  taisks.  Therefore, 
the  natxare  >?f  the  decision-making  environment  is  fundamentally 
different  for  diff'--ent  levels  of  interarrival  times.  At  different 
levels  of  interarrival  tim*e^  experimentally  controlled  task 
variables  and  their  interaction  have  different  effects  on  the 
variation  of  subjective  mentail  workload,  as  discussed  in  detail 
in  reference  5* 

7-  The  study  supi  i..  ts  the  notion  that  subjects  form  internal 
modelF  of  environment  basjd  on  their  own  abilities,  dispositions, 
and  te.  .encies  which  result  in  their  dissimilar  perceptions  of 
mental  workload.  In  the  auialysis,  the  underlying  characteristics 
of  the  subjects  was  inferred  from  their  judgment  patterns.  The 
differences  of  opinion  among  subjects  with  respect  to  mental 
worlU.oad  occures  when  the  subjects'  personal  characteristics 
result  in  adaptation  of  different  strategies  of  action.  It  is 
postulated  that  for  environments,  where  only  one  optimal 
strategy  of  action  exists,  trained  subjects  would  be  in  better 
agreement. 
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abstract 

This  study  iQvestigaCed  the  effects  of  tl«e  estl«atloa  tech- 
Qlque  aod  task  coodltlon  on  the  production  and  verbal  esclsatlon  of 
time  Intervals  ranging  from  S to  14  sec.  Sixteen  male  college  stu- 
dents vere  randomly  assigned  to  two  groups,  each  of  which  utilized 
a different  estimation  method:  (a)  production;  or  (b)  verbal 
estimation.  The  subjects  were  instructed  either  to  produce  or  to 
give  a verbal  estimate  of  the  duration  of  these  time  Intervals  dur- 
ing esch  task  condition;  (a)  pretracking,  *(b)  tracking  (subject 
performed  a one-axis  tracking  task),  and  (c)  posttracking.  Each 
subject  used  each  of  the  two  estimation  techniques:  (a)  vocal 
counting  and  (b)  no  counting.  The  ratio  of  the  subject*s  time  esti- 
mate to  actual  Interval  length  was  computed  for  each  trial. 

Productions  were  typically  longer  than  verbal  estimates  of  the 
same  duration  and  produced  durations  were  typically  too  long 
whereas  verbal  estimates  were  too  short  relative  to  the  correct 
duration.  These  effects  were  evident  in  both  the  counting  and  no- 
counting conditions,  with  and  without  a concurrent  tracking  task. 

A significant  Interaction  was  found  between  counting  technique 
and  tracking  condition  for  both  estimation  methods.  When  subjects 
were  instructed  to  count  out  loud  they  were  able  to  perform  an 
additional  tracking  task  while  maintaining  consistent  and  accurate 
performance  on  the  time  estimation  task.  In  contrast,  when  sub- 
jects were  Instructed  not  to  count  out  loud,  their  ability  to  keep 
track  of  time  while  performing  a tracking  cask  was  reduced. 

A significant  effect  could  be  attributed  to  the  addition  of  a 
cracking  task:  produced  durations  Increased  la  length,  whereas  ver- 
bal estimates  decreased  In  length.  The  durations  produced  without 
counting  were  significantly  leas  accurate  and  consistent  with  the 
addition  of  a cracking  task.  Verbal  estimation  mean  accuracy,  but 
not  consistency,  was  adversely  affected  by  the  addition  of  a crack- 
ing task  when  the  subjects  were  instructed  not  to  count. 

* This  research  was  conducted  at  NASA-Azaes  Research  Center  and  was  sponsored  by 
NASA  grant  NCC-2-34  to  San  Jose  State  University. 

**  This  research  was  conducted  at  NASA-Aaes  Research  Center  and  was  sponsored  by 
NASA  grant  NSG-2156  to  Tuft's  University. 
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Perforaance  oti  a secondary  cask  Is  often  used  ss  an  index  of 
priaary  task  workload.  Many  secondary  casks  are  designed  to 
Increase  the  overall  workload  in  order  to  measure  residual  capacity 
for  work  sti!l  availab'  during  perforeance  on  the  ealn  cask*  The 
assuaption  Is  that  processing  resources  are  lieited  and  that  per~ 
foraance  will  deteriorate  when  several  activities  coapete  for  the 
saae  resources  (Moraan  & Bobrow,  1975).  A secondary  task  nay 
interfere  with  perforaance  on  the  aain  task  If  it  eapIo>s  the  saae 
sensory *aotor  pathways  or  interferes  functionally  with  it  (Michon, 
1966).  A secondary  task  aay  eaploy  Che  saae  sensory^aotor  pathway 
If,  for  Instance,  an  operator  watches  a coapiicated  display  and 
calls  out  the  Inforaatlon  obtained,  while  at  the  saae  tiae  perfora- 
Ing  a secondary  task  chat  consists  of  calling  out  randoa  sequences 
of  letters  presented  visually*  Less  obvious,  however,  is  the  pos- 
sibility chat  a secondary  task  aay  interfere  functionally  with  the 
aain  task  without  asking  use  of  the  saae  peripheral  pathways*  For 
Instance,  if  one  of  the  tasks  used  to  investigate  workload  was  the 
selection  of  a changing  nuaber  in  a series  of  eight  digit  nuabers 
and  the  aain  task  consisted  of  deciphering  nuaerical  codes,  the 
perforaance  of  one  task  would  interfere  functionally  wl perform 
aance  on  the  other  task  even  if  one  task  was  presented  audltorlally 
and  the  ocher  visually  because  they  require  the  saae  processing 
resources  * 

An  alternative  type  of  secondary  task  is  one  which  does  not 
interfere  with  the  aain  task  but  does  require  soae  atteo*'  >n«  A9 
attention  required  by  the  primary  cask  increases,  second  cask 

perforaance  deteriorates,  thus  providing  an  Indirect  measure  of 
prlaary  task  demands* 

Tiae  estiaaclon  casks  which  aeas*<re  the  Individual’s  ability 
to  judge  the  passage  of  tiae  under  differe*it  clrcuastances  have 
been  used  as  secondary  measures  of  prlwsry  cask  workload  (Cold* 
scone,  Boardaan,  & Lhaaon,  1959;  Hart,  ^fcPherson,  & Looals,  197d)* 
As  prlaary  cask  demands  increase  and  attention  is  drawn  away  from 
time  estlaation,  estimates  typically  become  Less  accurate  and  more 
variable,  reflecting  the  level  of  concurrent  prlaary  task  demands* 
However.  this  occurs  without  degrading  perforaance  on  the  prlaary 
task* 

There  are  three  cxperiaental  methods  coaaonly  used  to  obtain 
time  estlastes:  (a)  verbal  estimation,  in  which  subjects  ver^alIy 

report  judgaents  of  elapsed  time  between  presentation  of  stimuli, 
(b)  proJ'^  tlon,  in  which  subjects  physically  generate  a time  inter- 
val specltled  by  the  expe r laente r , and  (c)  reproduction,  in  which 
subjects  physically  generate  a time  interval  previously  demon- 
strated by  the  experimenter* 

It  has  been  suggested  chat  Individuals  use  two  basic  aodes  of 
estimation:  active,  (prospective)  and  retrospective.  Active  estlaation  involves 

a conscious  attempt  to  keep  track  of  tiae  continuously  during  the  designated  in- 
terval. Various  tiaekeeping  techniques  aay  be  tried  such  as  counting,  mentally 
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replaying  3 'auslc3l  passage  of  ipproprlace  iuriclon^  and  counting 
heart  beats  or  breaths.  In  retrospective  estimation  subjects  can- 
not or  do  not  attend  to  Che  passage  of  time  during  an  Interval. 
Instead,  they  may  recall  events  that  occurred  during  th2  interval, 
co-apare  them  temporally  alth  experiences  of  icnovn  duration,  and 
arrive  it  an  estimate  of  the  amount  of  time  that  elapsed  during  the 
interval  at  Its  conclusion. 

Hlc'xs,  Miller,  and  <lnsbourne  ( 1976)  have  suggested  that  the 
apparent  inconsistencies  found  among  different  time  estimation  stu- 
dies may  be  attributed  to  a failure  to  distinguish  between  modes 
(active  and  retrospective)  employed.  31ndra  and  Vlaksberg  (195S) 
further  suggest  these  inconslstenc lea  may  be  explains!  In  terms  of 
the  experimental  method  (e.g.,  production,  verbal  estimation, 
reproduction)  employed.  For  example,  a common  finding  Is  that  the 
lengths  of  produced  and  verbally  estimated  durations  are  Inversely 
related.  'Jlth  the  production  method,  subjects  are  required  to  per- 
form a task,  e.g.,  depress  a key  for  a specified  period  of  time. 
If  thay  attempt  to  employ  an  active  mode  of  estimation  such  as 
counting  "one  thousand  one,  one  thousand  two,"  and  are  distracted 
during  the  Interval,  they  will  generally  resume  counting  where 
chey  left  off.  Their  performance  will,  therefore,  cone  ime  more 
time  than  they  estimate,  resulting  In  underestimation  of  elapsed 
rime  and  a produced  duration  that  Is  too  long.  If  distracted  from 
active  timekeeping  during  the  presentation  of  an  Interval  whose 
length  must  be  verbally  estimated,  subjects  will  again  underesti- 
mate the  elapsed  time  since  they  tend  to  overlook  the  period  of 
distraction  In  resuming  their  counting,  and  the  verbal  estimate 
dotation  < .:l  be  too  short.  Thus  the  Lengths  of  actively  made  ver- 
b.t  I est^aates  and  productions,  under  $lml..arly  distracting  condi- 
tions, will  be  Inversely  related  although  both  occur  as  a conse- 
quence of  underestimation  of  elapsed  time* 

Techniques  such  as  counting  or  tapping  that  focus  the 
^.object's  attention  on  the  time  estimation  task  and  segment  the 
interval  into  concrete,  standardized  units,  result  in  produced 
..u  atlons  that  are  less  variable  and  less  subject  to  the  dlstract- 
InK  effects  of  concurrent  activity  (Hart,  McPherson,  S Loomis, 
l)?3).  L 3 concrete  production  techniques,  such  as  mentally 
replaying  an  experience  of  known  duration,  result  In  productions 
that  1 more  variable  and  more  subject  to  distraction  from  con- 
carre  tasks.  The  accuracy  and  consistency  of  active"'^  made  verbal 
estimates  should  also  be  affected  by  the  estimation  technique 
employe!.  Techniques  such  as  counting  and  tapping  that  focus 
^..cencion  on  the  passage  of  time  should  result  in  verbal  estimates 
chat  are  less  subject  to  the  distracting  effects  of  concurrent 
activities.  The  Interactive  effects  of  estimation  technique  and 
coacurrenc  arf...vlcy  on  verbally  estimated  and  produced  durations 
hai  not  be^.i  studied  In  such  a mancei  as  to  allow  direct  comparison 
between  '.he  results  obtained  with  the  two  methods. 
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; »e  proposed  study  eKailned  the  effects  of  a concurrent  aauual 
control  task  on  time  estlnates  -sade  by  the  verbal  estlaatlon  and 
production  asthols.  Specifically,  It  attestpted  to  answer  these 
questions:  (a)  Does  the  presence  of  a concurrent  task  result  In 
verbally  estimated  iuratloas  that  are  Inversely  related  to  produc- 
tions obtained  under  slilllar  circumstances?  (b)  Does  a vocal- 
counting technique  result  In  more  stable  verbal  estimates  than  a 
no-counting  technique  with  no  concurrent  .activity?  (c)  \re  verbal 
time  estimates  that  use  continuous  vocal  counting  affected  by  Che 
Introduction  of  a concurrent  task?  (d)  Vre  verbal  time  estimates 
based  on  no  systematic  estivation  technique  affected  by  Che  Intro- 
duction of  a concurrent  cask? 


METHOD 


Subject  3 

Sixteen  male  college  students  ranging  in  age  from  IS  to  S5 
served  as  paid  volunteers.  They  were  alternately  assigned  by  order 
of  appearance  to  ch:  verbal  escimatlon  method  group  or  production 
method  group.  None  of  Che  subjects  had  participated  In  previous 
time  estimation  research. 

Apparatus 

This  study  was  conducted  in  a small,  enclosed  experlmentsl 
chamber.  The  subjects  were  seated  alone  In  a comfortable  chair  la 
front  of  a cathode-ray  Cube  (CRT).  A control  stick  with  i response 
button  was  located  directly  In  front  of  the  subject's  chair.  The 
response  button,  used  to  Initiate  and  terminate  productions  and  to 
begin  the  verbal  estimation  trials  had  an  audible  click  upon  both 
depression  ind  release.  An  intercom  transmit  ter/ receiver  was 
located  on  the  wall  next  to  Che  subject  to  allow  the  subject  and 
experimenter  to  commun icace  verbally. 

V display . The  experimental  tracking  Cask  was  displayed 
on  a n cm  x l3  cm  CRT  which  was  located  approximately  at  Che 
subject's  eye  l^vel.  The  subject  was  able  to  adjust  the  distance 
from  Che  chair  to  Che  CRT  between  Che  range  of  43.90  and  57.15  cm 
CO  ilLow  for  Individual  differences  In  visual  acuity. 

Experimenter*  s s*^atlon.  Data  acquisition  and  presentation  of 
experlmencal  con7ltlons  were  controlled  by  a Digital  Equipment  Cor- 
poration ®D?-12  computer.  The  experimenter  was  seated  outside  of 
the  experimental  chamber  near  the  PD?-12  computer.  A second  Inter- 
com transmitter  and  receiver  was  located  next  to  the  experimenter. 

Procedure 

Subj:':ts  were  familiarized  with  the  experimental  chamber  and 
asked  CO  put  their  watches  (If  any)  In  their  pockets.  Instructions 
appropriate  for  each  experimental  condition  were  read  aloud  and 
subjects  rfere  given  three  practice  trials  to  familiarize  them  with 
Che  procedure.  Each  subject  was  required  to  use  each  of  the  two 
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cl-ae-'^eepin^  technlqu3s  (vocal  counting  ani  no^countlng)  and  one  of 
Crfo  3scl'*ation  asthods  (proiuctl">n  or  verbal  estimation).  The  sub- 
jects estimated  or  produced  t5ue  intervals  with  and  uithouc  a con- 
current cask.  Ml  subjects  received  the  following  sequence  of  con- 
ditions for  counting  and  no-counting:  (a)  no  tracking,  (b)  crack- 
ing, ani  Cc)  no  cricking.  The  order  of  presentation  of  the  experi- 
mental conditions  was  the  same  for  both  the  production  and  verbal 
estimation  methods  however,  half  of  the  subjects  received  the  no- 
counting  trials  first  and  half  received  the  counting  trials  first. 
Thus,  each  subject  experienced  a total  of  six  conditions  (Table  1). 
Ten  durations,  each  presented  twice,  were  presented  in  a different 
random  order  for  the  six  conditions  experienced  by  each  subject. 
The  10  intervals  ranged  in  length  from  5 to  sec  in  l-sec  steps. 

Verbal  Ss t ima t ion . The  interval  to  be  verbally  estimated  was 
demonstrated  by  d if f erent  messages  on  the  CRT.  The  messages  “SSCIM 
lMT‘iRV\L“  and  “ESD  OF  IMTERVIL**  provided  the  interval  boundaries. 
The  message  “IHT5RVAL"  was  displayed  continuously  during  the  Inter- 
val. Subjects  were  required  Co  acknowledge  that  they  had  noticed 
the  beginning  and  end  of  the  Interval  presentation  by  pressing  the 
response  button.  After  each  interval  a message  ** ESTIMATE**  appeared 
on  the  screen  indicating  that  the  subjects  should  verbally  report 
rheir  judgment  of  the  duration  of  the  interval  (to  the  nearest 
second)  over  the  intercom  system.  The  experimenter  then  recorded 
each  estimate#  The  length  of  the  Interval  between  presentation  of 
trials  was  5 sec. 

Product  ion.  The  message  "BSGIM  ?R0D.[M  SSCl**  was  displayed  on 
the  CRT  ( where  N equals  the  number  of  seconds).  The  subject 
depressed  the  response  button  to  Initiate  the  production.  The  mes- 
sage on  the  screen  changed  to  **PR00.[S  SECl"  to  remind  subjects  of 
the  task  called  for.  The  subject  depressed  the  response  button 
again  when  he  felt  that  the  specified  amount  of  time  had  elapsed, 
and  the  message,  **ES0  OF  PROD.,**  appeared  on  the  screen.  The  sub- 
ject produced  the  19  different  time  intervals  twice.  The  Inter- 
trial  Interval  Length  was  5 sec. 

Counting/no  counting . In  the  no-counting  condition,  subjects 
were  asked  not  to  count  (vocally  or  subvocally)  or  perform  any 
rhythmic  activities  while  producing  an  Interval  or  during  presenta- 
tion of  Che  interval  whose  duration  was  to  be  verbally  estimated. 
They  were  instructed  chat  if  they  should  find  themselves  counting 
or  capping,  to  try  to  think  of  something  else  and  report  It  to  the 
experimenter.  For  the  counting  condition,  subjects  were  asked  to 
CDunc  aloud  using  the  method  **thousand  one,  thousand  two,  etc.** 

Tracking  task . The  tracking  task  consisted  of  a CRT  display 
upon  which  was  displayed  a moving  5.56  cm  vertical  line  (the  cur- 
sor). The  subjects  were  instructed  to  keep  this  cursor  centered 
between  two  stationary  2.11  cm  vertical  lines  by  maneuvering  the 
control  stick  right  and  left.  Maximum  displacement  of  the  cursor 
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-las  12*J7  c!i  subceniia^  a visual  angle  of  .32  rads  (16  deg  of  arc). 
Maximum  race  of  travel  was  63.50  cm/sec. 

The  moveacnC  of  the  cursor  was  generated  by  the  filtered  out~ 
;>uc  of  a random  number  generator.  The  random  number  generator  pro- 
vided a rectangular  distribution  of  frequencies  with  a bandwidth  of 
60  rad/sec.  These  values  were  passed  through  a first  order  filter 
with  a natural  frequency  of  I rad/sec.  The  standard  deviation  of 
the  forcing  function  was  1.18  cm  (see  Figure  1). 

RESULTS 

Effect  due  to  length  of  interval 

Each  subject  gave  two  verbal  estimates  or  made  two  productions 
for  each  of  the  10  different  Interval  lengths  under  each  of  t!  t six 
experimental  conditions  he  experienced*  The  mean  duration  or  the 
two  estimates  was  obtained  and  a ratio  was  formed  with  the  length 
of  the  Interval  to  be  Judged*  Values  greater  than  l.O  signified 
verbal  estimates  or  productions  that  were  too  long  and  values  less 
than  l.O  signified  verbal  estimates  or  productions  that  were  too 
short*  These  ratios  were  compared  within  each  time  estimation  con- 
dition using  twelve  one-way  analyses  of  variance  for  repeated  meas- 
ures to  determine  whether  the  length  of  the  Interval  estimated 
resulted  in  relative  differences  In  subjective  Judgments  of  dura- 
tion. Only  one  of  these  £ values  exceeded  the  critical  value  of 
1.74  for  9 and  S3  degrees  of  freedom  (Dixon  S Massey.  1937).  Using 
the  lOZ  s^gnlflcance  level.  It  Is  expected  that  I In  10  F tests 
will  be  falsely  significant  thus,  the  appearance  of  one  significant 
£ value  ( £ (9.63)  ■ 1.73,  £ <.10)  Is  not  unreasonable.  Since  no 
significant  differences  were  found  for  verbal  estimates  or  produc- 
tions attributable  Co  the  length  of  Che  time  Interval  judged,  the 
mean  ratios  were  combined  for  subsequent  analyses* 

Compa  r Ison  of  pre  t racking  and  post  tracking  (average  duration) 

\ T~  Tcountlng-no  counting)  x 5 ^(pre-  vs.  postcracking) 
analysis  of  variance  with  repeated  measures  on  both  factors  was 
computed  individually  on  verbal  estimates  and  productions.  These 
analyses  were  performed  to  determine  the  relationship  between 
estimates  obtained  prior  to  and  following  the  cracking  task.  With 
Che  production  method,  no  significant  effect  attributable  to 
counting  technique  was  found.  £ <1;  however,  precracklng  estimates 
were  significantly  shorter  than  posttracking  estimates,  F (1.7)  ■ 
7.86,  £ <.05.  Tnere  was  no  significant  Interaction  between  count- 
ing technique  anJ  pre-  and  posetracking  estimates.  £ (i.7)  « 4.11, 
£ >.05. 

'/Ith  the  verbal  esclraaclon  method  there  was  no  significant 
effect  attributable  to  counting  technique  alone,  F <1;  however, 
pratracklng  estimates  were  significantly  longer  than""  posttracking 
estimates,  £ (1,7)  • 6.29,  £ <.05.  No  significant  Interaction 
between  counting  technique  and  pre-  and  postcracking  estimates  was 
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found,  F (1,7)  • 3.14^  £ >.0  5 (s3-3  Figure 

\lchough  pretracking  productions  ‘^ere  significantly  shorter 
thin  po  s 1 1 r icic  i ng  , their  iverage  length  rfis  still  shorter  (Kli) 
Chan  the  mein  of  the  trac’-clng  productions  (1.32),  as  would  be 
expected.  ®retrac’<.ing  verbal  estimates  ware  longer  than  posttraclt- 
Ing  estimates,  however  their  average  length  (.91)  was  still  longer 
Chan  ill  triclcing  estimates  (.30).  In  effect,  the  subjects 
underestimated  elapsed  time  more  at  the  end  of  the  experiment  Chan 
Che  beginning  for  both  the  production  and  verbal  estimation 
methods.  \s  predicted,  the  length  of  verbally  estimated  and  pro- 
duced durations  were  inversely  related. 

Compa  r Ison  of  p r e t racking  and  posctrac’xing  (variability) 

\ 2 T counting  technique)  x ^ ( pre-  ^ . posttraclting  condition) 
analysis  of  variance  with  repeated  measures  on  both  factors  was 
pvfrforined  on  the  wichin-subjects  standard  deviations  for  the  ver- 
bal estimation  and  production  methods  individually  to  compare 
estimates  obtained  before  and  aft»iL  ^^rforming  the  trac‘<lng  task. 
For  the  production  method,  there  was  no  sign  leant  difference 
between  pre-  and  postcracking  estimates,  _F  (1.7)  - 1.38,  £ >.05, 
nor  was  there  any  significant  interaction  between  counting  tech- 
nique and  tracking  condition,  £ (1,7)  • 4,55,  £ >.05,  Estimates 
made  without  counting  ware  significantly  more  variable  than  those 
made  with  counting  for  both  pre-  and  posttracking  conditions,  F 
(1.7)  - 19.25,  £ <.0l . 

For  Che  verbal  estimation  method  there  was  no  significant 
difference  between  pretracking  and  posttracking  , £ (1.7)  • 4.12,  £ 
>.05,  nor  was  where  a significant  interaction  between  counting 
technique  and  the  precracklng  and  posttracking  conditions,  F (1,7) 
• 3,06,  £ >.05,  There  was  a significant  effect  due  to  the  count- 
ing technique,  F (1,7)  • 18.10,  £ <.0l  (see  Figure  3). 

F f f ec  t of  counting  tec  ha  jque  and  tracking  condition  on  production 
method  leverage  duration) 

The  effect  of  counting  technique  (counting  and  no-counting) 
and  cracking  condition  (pretracking  and  tracking)  on  production 
method  was  evaluated  using  a 2 (counting  technique)  x 2 (tracking 
condition)  analysis  of  variance  with  repeated  measures  on  both 
factors.  There  wis  no  significant  difference  attributable  to 
counting  technique  alone,  F (1,7)  - l.3i,  £ >.05.  There  was  a slg- 
nlfl,;anc  difference  attributable  to  tracking  condition,  £ (1,7)  ■ 
17,68,  £ <.0l,  and  a significant  interaction  between  counting  tech- 
nique and  tracking  condition,  £ (1,7)  - 12.19,  £ <.05.  During  the 
pretracking  condition,  productions  obtained  with  and  without  the 
counting  technique  were  not  significantly  different  (Table  2). 
However,  when  subjects  were  required  to  perform  a concurrent  track- 
ing task,  productions  made  without  counting  increased  in  length  by 
nearly  50  X (from  1.03  co  l.5l)  whereas  the  productions  made  with 
counting  increased  only  slightly  (from  l.OV  to  1.12).  See  Figure  4. 
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Effect  of  count  1 techalque  ind  t racSclnq  cond  1 1 loa  on  produc t ion 
method  ^vn r I ahl 11 1 yl 

\ 2 (counting  technique)  x 2 (pretrecVclnj  vs*  tracking  condi- 
tion) analysis  of  variance  vilth  repeated  measures  on  both  factors 
vas  performed  on  the  vlthln- subjects  standard  deviations  of  the 
ratios  of  produced  duration  to  the  specified  duration.  Durations 
produced  vlth  no  counting  were  significantly  more  variable  than 
those  made  with  counting.  £ (l«7)  ■ 18.87.  £ <*0l.  Although  there 
was  no  significant  overall  difference  In  production  variability 
attributable  to  the  tracking  condition.  £ (1,7)  • 4.77.  ^ >*05. 
there  was  a significant  Interaction  between  Counting  techalque  and 
tracking  condition,  F (1,7)  - 12.16,  £ <.05.  The  mean  standard 
deviations  ranged  from  .04  to  .37  with  no  counting  and  from  .01  to 
•17  with  counting.  With  counting,  mean  standard  deviations  were 
.05  both  with  and  without  tracking.  When  subjects  were  not 
allowed  to  count,  however,  mean  standard  deviations  Increased  to 
.11  with  no  concurrent  tracking  task  and  to  .22  for  the  cracking 
condition  (see  Figure  5). 

Effect  of  counting  technique  and  tracking  condition  on  verbal 
eat Imac ion  method  ( average  duration) 

The  effect  of  counting  technique  and  tracking  (pratracklng  vs. 
tracking)  condition  on  verbal  estimates  was  evaluated  In  a 2 
(counting  technique)  x 2 (tracking  condition)  analysis  of  variance 
with  repeated  measures  on  both  factors.  There  was  no  significant 
difference  attributable  to  counting  technique  alone,  £ <l  and  no 
significant  interaction  between  counting  techalque  and  tracking 
condition,  £ (1,7)  - 5.33,  £ >.05.  Pretracking  estimates  were  ilg- 
nlflcantly  longer.  F (1,7)  - 15.62.  £ <*01.  chan  estimates  obtained 
during  tracking  (.9?  versus  .79)  although  both  were  shorter  than 
the  standard.  Wthough  there  was  no  significant  interaction 
between  counting  technique  and  tracking  condition,  the  difference 
between  the  mean  ratios  of  the  no  counting  condition  for  pretrack- 
tng  and  tracking  conditions  was  .23,  while  the  difference  was  only 
.04  In  the  counting  condition  (see  Figure  6). 

Effect  of  count  Ing  technique  and  tracking  condition  on  verbal 
estlmatlo  n^T^  rlablllty) 

\ 2 Tcountlng  technique)  x 2 (ptetracklng  vs.  tracking) 
analysis  of  variance  with  repeated  measures  on  both  factors  was 
performed  on  the  wl thin- sub Jec t standard  deviations  of  the  ratios 
of  verbally  estimated  to  standard  durations.  Estimates  made 
without  counting  were  significantly  more  variable,  F (1,7)  • 12.47, 
£ <.0l,  than  those  made  with  counting,  but  no  main  effect  due  to 
tracking  condition  was  found.  £ (1,7)  - 2.85,  £ >.05.  The 
Interaction  between  counting  technique  and  tracking  condition  was 
significant,  F (1,7)  • 7.10,  £ <.05.  Pretracking  estimates  were 
more  variable  (.17)  than  estimates  obtained  In  the  tracking  condi- 
tion C.ll)  for  the  no  counting  technique,  a decrease  rather  than 
the  expactei  increase.  With  counting,  standard  deviations  of  ver- 
bal esttma»*es  were  nearly  Identical  with  and  without  tracking  (.06 
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ml  .05,  rospec  t L ve  ly ) . Sae  Figure  7. 


Coapa r i son  of.  the  verbal  esc  laat  Ion  aad  produc  t ion  methods  ( average 
jurat  log) 

The  effect  of  estimation  method  vas  examined  in  a 2 (estima* 
tion  method)  x 2 (counting  technique)  x 2 ( pret  rac'xing  vs.  tracking 
condition)  mixed  analysis  of  variance  with  repeated  measures  on 
counting  technique  and  tracking  condition  . There  was  a signifi- 
cant difference  attributable  to  estimation  method*  £ (1*14)  • 6.91* 
£ <,05.  Produced  durations  were  typically  longer  than  the  standard 
whereas  verbal  estimates  of  duration  were  typically  shorter.  There 
was  no  significant  difference  due  to  counting  technique  alone*  £ 
(1,14)  « 1.83*  £ >.05*  or  tracking  condition  alone  (pretracking  and 
tracking)*  £ (1*14)  * 1.65*  £ >.05.  A significant  interaction  was 
found  between  estimation  method  and  tracking  condition*  £ (1*14)  • 
32.36*  £ <.001  among  estimation  method*  counting  technique*  and 
tracking  condition*  £ (1*14)  • 17.30,  £ <.001. 

The  length  of  the  subject's  productions  increased  with  Che 
cracking  task  (with  and  without  counting)  however*  there  was  less 
increase  when  subjects  were  permitted  to  count.  The  length  of  the 
subjects'  verbal  estimates  decreased  during  the  tracking  task  con- 
dition* with  and  without  counting.  Again*  the  magnitude  of  the 
change  was  less  when  the  subjects  were  permitted  to  count.  During 
pretracking*  mean  produced  durations  were  virtually  the  same  with 
and  without  counting  (1.03  and  1.04)*  however  the  verbal  estimates 
made  with  counting  (.37)  were  significantly  shorter  than  those 
made  without  (1.03). 

Comparison  ' o£  verbal  estimation  and  production  methods 
( vaWablli  ty  ) 

A 2 (estimation  method)  x 2 (counting  technique)  x 2 (pre- 
tracking vs.  tracking  condition)  mixed  analysis  of  variance  with 
repeated  measures  on  the  counting  technique  and  tracking  condition 
was  performed  on  the  standard  deviations  of  the  ratios.  No  signifi- 
cant differences  attributable  to  variability  were  found  for  estima- 
tion method*  £ <l * or  tracking  condition  (pretracking  vs.  track- 
ing)*  £ (1,14)  ■ 1.17*  p >.05.  Variability  was  significantly 
greater*  £ (I*l4)  ■ 31.79*  £ <.001*  for  the  no  counting  technique 
(range  .04  to  .37)  than  the  counting  technique  (range  .01  to  .17), 
There  was  a significant  interaction  between  astimation  method  and 
tracking  condition*  £ (1,14)  ■ 7.46*  £ <,05  and  among  estimation 
method*  counting  technique,  and  tracking  condition*  £ (1*14)  ■ 
18.89*  £ <.001.  With  the  counting  technique,  there  was  ^a  slight 
increase  in  mean  variability  of  verbal  estimates  with  the  addition 
of  tha  tracking  task  (from  .05  to  .05);  however*  there  was  no 
change  for  the  production  method  (.050  versus  .050).  Without 
counting,  however,  verbal  estimation  variability  decreased  between 
the  pretracking  (.17)  and  tracking  (.11)  conditions.  There  was  a 
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substinclal  In^reise  tn  Tie.in  varlablltty  between  the  pretrackln? 
(.11)  and  tracking  (•22)  conditions  for  the  production  method.  The 
decrease  In  variability  for  Che  no-counting  verbal  estimations  may 
have  occurred  If  Che  subjects  became  very  distracted  by  Che  track- 
ing Cask  and  responded  by  repeatedly  reporting  Che  same  estimate, 
therefore  decreasing  the  variability  among  estimates  for  the  track- 
ing condition* 


OISCUSSIOM 

Each  subject  consistently  overestimated  or  underestimated  the 
different  Intervals  by  a relatively  consistent  percentage  Indepen- 
dent of  the  Interval  length.  For  this  reason  the  ratios  of 
estimated  to  actual  durations  within  each  experimental  condition 
were  pooled  for  subsequent  analyses. 

A consistent  difference  was  found  between  the  lengths  of  pro- 
duced and  verbally  estimated  durations:  productions  were  con- 
sistently longer  than  verbal  estimates  of  the  same  intervals  (Fig- 
ure 2),  In  addition,  produced  durations  were  typically  too  long 
whereas  verbal  estimates  were  too  short  relative  to  Che  correct 
duration.  These  effects  were  evident  In  both  the  counting  and  no- 
countlug  conditions,  with  and  without  a concurrent  tracking  task. 

As  hypothesized,  an  Inverse  relationship  between  the  length  of 
time  productions  and  verbal  estimations  was  found.  Tne  addition 
of  a tracking  task  made  the  relationship  clearly  evident:  produced 
durations  Increased  In  length,  whereas  verbal  estimates  decreased 
In  length  for  both  estimation  techniques.  Ths  greatest  difference 
between  production  and  verbal  estimation  occurred  If  the  subjects 
did  not  count  as  predicted.  Produced  iurations  were  twice  as  long 
as  verbal  estimates  with  no  counting  whereas  they  were  only  half 
again  as  long  with  counting  during  the  tracking  condition.  There 
was  also  an  Interesting  Inverse  relationship  between  Che  standard 
durations  of  produced  and  verbally  estimated  durations:  production 
variability  Increased  with  the  addition  of  a cracking  t«sk  whereas 
verbal  estimation  variability  decreased.  Again  the  differences 
between  the  two  methods  were  particularly  great  when  subjects  did 
not  count. 

Although  there  was  no  significant  difference  In  productions  or 
verbal  estimates  due  to  counting  technique  alone,  a significant 
Interaction  was  found  between  counting  technique  and  tracking  con- 
dition for  both  estimation  methods.  When  subjects  were  permitted 
to  use  an  overt  form  of  timekeeping,  they  were  able  to  perform  an 
additional  tracking  task  while  maintaining  consistent  and  accurate 
performance  on  a production  or  verbal  estimation  task.  There  was 
only  a slight  decrease  In  the  length  of  verbal  estimations  and  a 
slight  Increase  in  the  length  of  productions  when  the  subjects  per- 
formed a tracking  task  while  vocally  counting. 
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In  contrasc,  when  the  subjects  ware  Instructed  not  to  count 
out  Loud,  their  ability  to  keep  trick  of  tlmi  while  performing  a 
tricking  task  was  reduced.  The  durations  produced  without  counting 
wera  significantly  less  accurate  and  consistent  with  the  addition 
of  a tracking  task.  Verbal  estimation  accuracy,  but  not  con- 
sistency, was  adversely  affected  by  the  ad’lt^on  of  a tracking  task 
If  the  subjects  were  Instructed  not  to  count. 

Because  performance  on  the  tracking  task  was  the  same  h 

both  production  and  verbal  estimation  techniques.  It  appears 
the  subject’s  shift  of  attention  away  from  time  estimation 
with  the  no  counting  technique  was  not  because  subjects  coulc 
perform  both  tasks  but  merely  that  they  did  not.  When  atten. 
was  focused  on  the  time  estimation  task  by  the  counting  technique, 
production  and  verbal  estimation  accuracy  was  not  degraded  and 
there  was  no  concomitant  degradation  of  tracking  task  performance. 

These  results  support  the  findings  of  Hart  (1975)  who  asked 
subjects  to  estimate  and  produce  10-,  20-,  and  30-sac  Intervals 
while  performing  six  different  compensatory  tracking  tasks.  Pro- 
duction lengths  and  ^driablllty  Increased  and  verbal  estimate 
lengths  decreased  as  concurrent  task  difficulty  Increased. 

The  overall  difference  between  the  counting  and  no-countin'*, 
technique  on  the  ratio  of  estimated  to  required  time  was  greater 
for  the  production  method  (1.26  vs.  1.13)  than  for  the  verbal  esti- 
mation method  (*3B  vs.  .86)  as  was  the  difference  In  average 
wlthln-sub ject  standard  deviation  (.16  vs.  .05  for  productions  and 
.13  vs.  .05  for  verbal  estimates).  In  addition,  the  magnitude  of 
the  interaction  between  counting  technique  and  presence  or  absence 
of  concurrent  activity  was  greater  for  produLtlons  than  verbal 
estimates.  Whether  or  not  the  subject  was  permitted  to  vocally 

count  did  not  seem  to  have  as  large  an  effect  on  the  length  of  the 

subje^-ts  verbal  estimates  as  it  did  on  his  produced  durations. 

These  experimental  results  support  the  findings  of  Hart, 
McPherson  and  Loomis  (1978)  who  report  that  techniques  such  as 
counting  or  tapping  that  focus  the  subject's  attention  on  the  time 

estimation  task  segment  the  Interval  into  concrete,  standardized 

units,  resulting  In  produced  durations  that  are  less  variable  and 
less  subject  to  the  distracting  effects  of  concurrent  activity. 
Presumably,  counting  should  have  a slmlllar  effect  on  the  verbal 
estimation  method  and  result  In  estimates  that  are  less  subject  to 
the  distracting  effects  of  concurrent  activities,  when  In  fact  the 
subjects'  estimates  of  the  duration  of  the  intervals  ware  quite 
slmlllar  for  both  the  counting  and  the  no-counting  conditions  when 
the  subjects  performed  the  tracking  task. 

The  nature  of  the  two  estimation  methods  are  somewhat  dif- 
ferent. The  production  method  Is  an  active  process  In  that  the 
subject  plays  a role  In  actually  producing  the  time  Interval.  The 
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verbal  escLmatloti  method  Is  a more  passive  proceps  in  that  the  sub- 
ject muse  verbally  esttmati  the  duration  of  the  Inierval  but  plays 
no  role  In  delimiting  the  actual  Interval  length.  Because  of  the 
passive  nature  of  the  verbal  estimation  method  the  possibility 
exists  that  the  subjects  judged  the  Interval  duration  relative  to 
the  preceding  Interval  or  used  some  form  of  categorization  to  judge 
^hlch  Interval  had  li^'n  presented  rather  that  viewing  the  time 
Intervals  as  a whole  series  of  Independent  estimates.  It  is  dlffl* 
cult  to  determine  If,  In  fact,  these  methodological  differences 
contributed  to  the  different  experimental  results,  however  the  pos- 
sibility must  be  considered. 

\ significant  difference  was  found  between  the  pretraclclng  and 
pos  **racklng  baseline  conditions  for  the  production  and  verbal 
estimation  methods.  The  length  of  the  productions  Increased  from 
pretraclclng  to  post  tracking  for  both  counting  and  no  counting  tech- 
niques, although  the  increase  was  greater  without  counting  than 
with  counting.  Conversely,  verbal  estimates  decreased  la  Length  for 
both  the  counting  and  the  no-counting  conditions,  and  again  the 
difference  was  greater  with  the  no-counting  technique  than  for  the 
counting  technique.  Tnese  results  are  slmlllar  to  those  reported 
by  Carlson  and  Felnberg  (1970)  who  found  that  counting  rate 
decreased  from  the  beginning  to  the  end  of  each  session  for  the 
production  method.  a decreased  counting  rate,  the  length  of 
the  productions  would  be  expected  to  Increase.  They  further 
reported  an  Increase  In  counting  rate  with  the  verbal  estimation 
method  which  would  results  In  a decrease  la  the  length  of  verbal 
estimations  over  trials. 

No  significant  Interaction  was  found  between  counting  tech- 
nique and  pre-  and  posttracking  conditions  for  either  estimation 
method  despite  the  fact  that  the  no-counting  and  counting  condi- 
tions were  affected  somewhat  differently  by  the  tracking  condition 
(pre  or  post  tracking).  These  contradictory  results  may  have 
occurred  due  to  th  'arge  wlthln-sub Ject  variability  encountered  In 
Che  no-counting  conaltlon. 

These  results  would  sees  to  support  Hogan's  (1978)  premise 
cnat  boring  time  Intervals  are  experienced  as  longer  than  non- 
boring  Intervals.  When  subjects  performed  a tracking  task  while 
verbally  estimating  the  lengths  ot  time  intervals,  the  estimates 
decreased  In  length.  When  they  performed  a tracxlng  task  while 
producing  time  intervals,  the  productions  increased  In  length*  It 
is  conceivable  that  the  subjects  perceived  the  Cracking  task  Inter- 
vals as  more  stimulating  or  interesting  chan  the  non-tracking 
intervals,  thus  shorter.  When  the  cracking  task  was  removed  and 
the  time  Intervals  were  leas  stimulating  or  Interesting  for  the 
subjects,  verbal  estimate  lengths  increased  and  production  lengths 
decreased,  Indicating  that  ne  subjects  may  have  experienced  bore- 
dom • 
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The  lengths  of  the  postcratVln^  pr;iivictl<>ns  ini  verbal  estl- 
m.itiens  miy  hive  also  been  Influenced  by  a fatigue  factor*  The 
subjects  'Were  required  Co  lijusc  to  the  posccrachin'^  conilclon 
ifter  they  hii  experienced  Che  xore  scitaulicln^  CracJcln^  tas'<  con- 
iltton*  The  decreise  in  Che  co^nlclvc^’socor  scl>xulaCion  aay  have 
resulted  in  less  vigilant  actencion  Co  Che  ciae  esrlaaclon  Cis^* 

These  cxperlasntal  results  leacnsc r ace : (a)  The  relative 
accjracv  of  both  verbal  eaclaaces  and  produced  durations  appears  to 
he  roughly  equivalent  for  standard  Intervals  ranging  froa  5 to  14 
s>c,  indie. ting  soitc  consistency  in  individual  estimation  abllaty 
or  style.  (b)  Ks  the  difficulty  of  concurrent  activity  Is 
increased,  chu  length  of  tine  productions  increased  and  the  length 
of  verbal  estimations  decreased.  (c)  If  subjects  count  while  pro- 
ducing or  verbally  estimating  the  length  of  *n  interval,  the 
resulting  estimates  will  be  more  consistent.  (d)  Counting  tech- 
niques (vocal  counting  vs.  no  counting)  differentially  affect  the 
lengths  ol  time  productions  and  verbal  estimations  both  in  the 
presence  or  absence  of  additional  tas^s.  (e)  The  length  of  produc- 
tions increased  ind  the  length  of  verbal  estimations  decreased  from 
before  trecWlng  to  after  tracking,  (f)  The  effect  of  concurrent 
activity  on  time  sstlmatlons  was  less  pronounced  when  subjects  were 
permitted  to  use  the  vocal  counting  technique  and  (g)  Verbal 
estimates  obtained  with  both  counting  techniques  were  less  affected 
by  a concurrent  task  than  were  productions. 
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Table  1 

Olagrammatlc  RepreaentaMcn  of 
Ex  per  i^xental  Oealgr 


Production  Method 
(N  - 8) 


Pretrack 

Track 

Counting 

No  Counting 

Verbal  Estimation  Method 
(N  - 8) 
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Table  2 


Suaaary  Table  of  Means  snd  W I t h 1 n- Sub j ec t Scanisrd  Dsvlstloas 
(1)  Production  and  (2>  Verbal 
Esc Imac Ion  Methods 


Production  Method 

Counting  Condition 

Tracking 

Condition 

Pretracking 

Tracking 

Mean 

Mo-couat In) 

1 .04 
(.11) 

1.51 

(.22) 

1.27 

wOun t Ing 

1 .03 
(.05) 

1.12 

(.05) 

I.IO 

Mean 

l.OS 

1.32 

Verbal  Sstlsatlon  Method 

Counting  Condition 

Tracking 

Condition 

Pretracking 

Tracking 

Mean 

Mo-count Ing 

1 .05 
(.17) 

.76 

(.11) 

.90 

Count  1 ng 

.37 

(.05) 

.33 

(.06) 

.35 

Mean 

.96 

.80 

Mote:  Standard  deviations  are  In  parentheses, 

directly  below  se^n  scores. 
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Figure  1.  Dlagranaatic  Representatcion  of  Tracking  Task 
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TRACKING  CONDITION 

Figure  2.  Mean  of  Ratios  of  Estimates  to  Actual  Time 
for  Production  and  Verbal  Estimation  Methods 
(N  • 8) 
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Q PRODUCTION 


TRACK  track 

TRACKING  CONDITION 

Figure  3.  Standard  Deviation  of  the  Mean  of  Ratios  of 
Estimates  to  Actual  Time  for  Production  and 
Verbal  Estimation  Methods  (N  ■ 16) 
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(N  • 8) 


208 


SD  OF  THE  MEAN  OF  RATIOS  OF  ESTIMATES  TO  ACTUAL  TIME 


cKiC’.r’ ' - r.‘  j 

OF  POOR  QUALli'Y 


1.60 


!.50 


COUSTING 

□ NOT  COUNTING 


TRACK  TRACK 


TRACKING  CONDITION 


Figure  6. 


Kean  of  Ratios  of  Estimates  to  Actual  Time 
(No  Counting  - Counting)  for  Verbal  Estimation 
Method  (N  - 8) 


no 


Ot  Tilt  ritAil  or  RATIOS  OF  LSTIMATES  TO  ACTUAL  TlUt 


C": 


Or 


TRACK  TRACK 

TRACKING  CONDITION 


Figure  7.  Standard  Deviation  of  the  Mean  of  Ratios  of 

Estimates  to  Actual  Time  (No  Counting  - Counting) 
for  Verbal  Estimation  Method  (N  « 8) 
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EFFECT  OF  ESTIMATION  TECHNIQUE  AND  TASK  CONDITION  ON  TIME  ESTIMATION  METHODS  (F) 
Kathl««n  L.  Bird,  San  Josa  State  Univ.  and  Sandra  G.  Hart,  Tufts  Univ. 

This  scuay  investigatsa  tha  affects  of  title  estimation  technique  and 
t:isl<  condition  on  the  proauction  ano  verbal  estimation  of  time  intervals 
rang'n:?  from  5 to  14  sec.  Sixteen  male  college  students  were  roncomly 
:.i  \j  t.;o  ^rouos,  of  vhich  »x  per  i "»r.c  a nifftr^nt  estimation 

methoc  : (a)  proauction;  or  (b)  verbal  estimation.  The  subjects  were 

instructaa  to  either  produce  or  give  a verbal  estimate  of  tha  duration  of 
tn*se  time  intervals  curing  each  task  ccnaition:  (a)  baseline  1 (pre- 

tracking  baseline);  (b)  tracking  (subject  performed  a one-axis  tracking 
task);  ana  (c)  baseline  2 (posttracking  baseline).  All  subjects  per- 
formed the  time  estimation  task  with  each  condition  using  both  estimation 
techniques:  (a)  vocal  counting  ana  (b)  no  counting.  The  ratio  of  sub- 

jects time  estimate  to  actual  interval  length  was  computea  for  each 
trial . 

A consistent  difference  was  found  between  the  lengths  of  proauced 
ana  verbally  estimated  durations  of  the  10  time  intervals.  The  subjects 
productions  were  typically  longer  than  the  verbal  estimates  of  the  same 
duration.  Produced  durations  were  typically  too  long  ana  verbal  esti- 
mates were  too  short  relative  to  the  actual  interval  duration.  These 
effects  were  evident  in  both  the  counting  ana  no-counting  conditions, 
with  and  without  a concurrent  tracking  task. 

Estimation  technique  alone  did  not  produce  a significant  effect  for 
either  tine  estimation  method  possibly  due  to  the  large  wi thin-subject 
variability  for  the  no-counting  conoition.  A significant  interaction  was 
found  between  estimation  technique  ana  task  condition  for  both  estimation 
methods.  When  subjects  were  instructed  to  count  out  loud  they  were  able 
to  perform  an  adaitional  tracking  task  while  maintaining  consistent  and 
accurate  performance  on  the  time  estimation  task.  In  contrast,  when  sub- 
jects were  instructed  not  to  count  out  loud,  their  ability  to  keep  track 
of  time  while  performing  a tracking  task  was  reduced. 

A significant  effect  could  be  attributed  to  the  aadition  of  a track- 
ing task:  proauced  durations  increased  in  length,  whereas  verbal  esti- 

mates aecreasec  in  length  with  ana  without  counting.  The  durations  pro- 
aucea  without  counting  were  significantly  less  accurate  and  consistent 
wltn  the  addition  of  a tracking  task.  Verbal  estimation  accuracy,  but 
not  consistency,  was  adversely  affected  by  the  addition  of  a tracking 
task,  if  the  subjects  were  instructed  not  to  count. 

These  findings  indicate  that  there  is  an  inverse  relationship 
between  the  length  of  subject’s  proauctions  and  the  length  of  verbal 
estimates,  ‘•^hen  the  subject  is  instructeo  to  vocally  count,  the  within- 
subject  variability  decreases  and  the  subject’s  ability  to  estimate  time 
interval  durations  is  less  affected  by  performance  of  a concurrent  track- 
ing task.  In  contrast,  when  the  subject’s  were  instructea  not  to  count, 
the  accuracy  of  time  productions  ana  verbal  estimates  was  hindered  by  the 
acaicion  of  a concurrent  tracking  task. 

Performance  on  a secondary  task,  e.g.,  estimating  time  intervals,  is 
often  used  as  an  index  of  primary  task  workload,  in  this  case,  a compen- 
satory tracking  task.  The  assumption  is  that  processing  resources  are 
limited  ana  that  perfoimance  will  deteriorate  when  several  activities 
compete  for  the  same  resources.  The  results  indicate  that  both  time 
estination  methoas  were  simzliarly  affected  by  the  addition  of  a tracking 
task.  Th?  increase  in  production  lengths  and  aeciease  in  verbal  estimate 
l3ngths  both  resulted  from  underestimation  of  elapsea  time.  ’.Vhen  sub- 
jects were  instructed  to  count,  ana  were  distracted  by  a task,  the/  gen- 
erally resumed  counting  where  they  left  off.  The  interval,  therefore, 
:onsumea  more  time  than  the  subject  estimated  lesulting  in  produced  aura- 
tlons  that  were  too  long  and  verbal  estimates  that  were  too  short. 
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Title:  Pilot  Workload  In  the  Air  Transport  Environment:  Theory, 

Measurement,  and  the  Influence  of  Air  Traffic  Control 


ABSTRACT 


The  operating  environment  of  an  air  tr  isport  crew  is  characterized  by 
multiple  Interrupting  tasks,  these  tasks  being  composed  of  a mixture  of 
purely  physical  control  and  purely  mental  planning  processes.  Measurement  of 
crew  workload  is  thus  a difficult  undertaking  due  to  the  necessity  to  re- 
solve workload  contributions  Imposed  by  several  sources.  These  sources  in- 
cludis  physical  efforts,  mental  efforts,  random  task  interruptions,  and 
emot;u*'il  disturbances. 

A subjective  opinion  rating  scale  *s  presented  for  use  as  an  effective 
workload  measure  for  this  air  transport  cockpit  environment.  Flight  simulator 
experiments  will  be  run  to  evaluate  the  degree  of  pilot  acceptance  and  the 
consistency  and  sensitivity  of  the  rating  scale.  During  these  experiments 
other  candidate  workload  measures  (sinus  arrythmia,  task  performance,  flight 
control  activity)  will  be  recorded  for  comparison  with  the  ratings  from  the 
subjective  scale. 

Finally,  an  analysis  is  presented  which  indicates  that  a major  component  of 
workload  Is  induced  by  the  federal  air  traffic  control  system.  Mechanizations 
of  this  loading  include  speed  and  altitude  restrictions  imposed  by  regulation, 
confinement  and  restraint  imposed  by  the  structure  of  the  National  Airspace 
System,  and  loads  induced  by  a stochastic  interruption  process  associated 
with  voice  communications.  Flight  simulator  experiments  will  be  run  that 
attempt  to  measurt  loading  effects  due  to  the  presence  of  air  traffic  control 
voice  communications  during  the  approach  phase  of  a flight  mission. 
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UorKlood  and  Pilot  E40  Sconnln9  Bohovior 
Toldi«4t  J,R.«  Ephraih*  Stoph«ns«  ^.T.«  ond  Young«  L.R^ 

Biomodlcal  Enginooring  Contor  for  Ciinicol  Instrumontai Ion  and 
Doportmont  of  Boronouilcs  and  Astronoui  ics«  f1. 1.T. 

B number  of  schemes  houe  been  aduonced  over  the  years  to  measure  tho 
pilot's  menial  vorKload.  These  schemes  include  side  tasKj^«  physiological 
measures#  and  subjective  quest iona ires.  Uhile  these  methods  uorK  reasonably 
uell  in  the  laborotory  and  in  ground  based  siinulotors#  ger;wrally  they  are  not 
well  suited  to  the  production  of  continuous#  real  ti're  quontitative  data  in 
flight.  In  an  effort  to  develop  a technique  suitable  for  implementat ion  in  the 
field#  ue  hove  investigated  the  pi#ot's  instrumert  scanning  behovlor  unde^ 
vQTious  levels  of  mental  loading. 

In  the  current  uorK#  experiments  were  conducted  in  the  Terminal  Configured 
Vehicle  (TCV)  ground  based  flight  simulator  at  NASA  Longley  Reseorch  Center. 
Three  NASA  test  pilots  uere  presented  with  a piloting  task#  on  arithmetic  task 
designed  to  vory  mental  locHina#  and  a side  task  for  calibration  of  the  mental 
loading  task.  The  pilot  lookpoint  wos  obtoined  using  a highly  modified 
Honeywell  oculometer  system.  Pilot  eye  scon  of  instruments  was  recorded  in  all 
coses, os  discussed  below.  The  piloting  task  Involved  flying  a curved  flicrowove 
Landing  System  (M.S)  opprooch  from  a specified  woypoint  to  touchdown.  *^o  aid  in 
date*  analysis  the  opprooch  wos  divided  into  six  segments!  downwind#  tu'^n  to 
base#  base#  turn  to  opprooch#  opprooch#  and  fiare.  The  pilots  were  aided  by  a 
new  generotion  of  flight  instruments  based  on  CRT  disploys  which  were  installed 
in  the  simulator 

The  mental  loading  tosk  wos  chosen  so  os  not  to  interfere  with  «he  visual 
sconning  of  the  pilot  iMllc  providing  constant  loading  during  the  eppr  och*  A 
series  of  evenly  spaced  three*number  sequences  which  were  present  d v really. 
The  pilots  were  asked  to  vmrbolly  indicate  the  relot is/e  ordering  ct  a :^;erles. 
he  wos  instructed  to  give  these  responses  a priority  equo^  to  the  prlRnry 
piloting  tosk.  The  difficulty  of  the  task  was  controlled  by  varying  the 
inte^'^/ol  between  numbs  sequences. 

The  workload  measuring  side  task  employed  two  lights#  one  mounted  r.uove  the 
other  placed  just  outside  the  pilot's  peripheral  view  just  above  the  inst**ument 
panel.  This  wos  done  only  when  the  pilot  hod  time  left  from  performing  the 
primory  tosk  of  flying  the  oirplane.  Thus  the  number  of  correct  responses  on 
the  lights  gave  o meesure  of  the  residual  capacity  of  the  pilot  from  which 
workload  con  be  calculated. 

Ty^e  conditions  uere  the  presence  or  absence  of  traffic  (other  airplanes  in 
the  some  approach  pot tern)  on  the  pilot's  CRT  disploy#  presence  or  absence  of 
the  side  task  lights#  and  mental  loodlng  task  (no  numbers#  three-nunber 
sequences  at  2B  sec  ond  10  sec  iniervols).  Two  replicotions  were  obtained  for 
eoch  pilot. 

Visual  inspection  of  X^Y  plots  of  pilot  scon  over  eoch  approach  segment 
show  large  quolitotive  differences  between  different  levels  of  loading. 
First-order#  discrete-stote#  discrete-transit  ion  ttorkov  models  are  used  os  c 
first  step  in  the  doto  onolysis.  It  is  assumed  thot  workload  is  constant  olong 
eoch  of  the  six  approach  segments  since  the  workload  and  piloting  tasks  ore 
essentially  constant  over  e^ch  segment.  This  allows  comparison  of  the 
instrument  transition  motricies  for  ecch  segment  with  those  obtaikted  under 
different  loading  conditions.  The  relationship  between  visual  scanning  ond 
worklood  is  given  by  the  chonge  in  the  elemonts  of  these  matrices  as  loading 
varies. 

This  work  wos  supported  by  NASA  cooperative  agreement  sHCCI-23 
mAddress  t Dr.  J.R.  Tele#  20A-113#  MIT#  Cambridge#  floss. 
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Tbm  Locus  of  Frocosolog  DoMods  of  Blgbor^ordor  Control: 
An  Iloctrophyslolotlcol  A^rooch 
dirlotophor  D*  Vlckono  ond  ticHord  Gill 
Univorolty  of  Illinois 


Roooorch  has  noil  sstabllshad  that  tha  danands  ia^oaad  npon  tha 
opa rotor's  llaltad  ptocasalng  rasourcas  art  grsstar  in  tha  control  of  so* 
c<mmS,  as  opposad  to  firsts  ordar  dytsanlcs*  Hoaaaar»  within  tha  /rarntworh 
of  nora  sophist icatad^  nultidinansional  nodala  of  procasaing  rasonrcas,  tha 
locus  of  such  danands  is  not  wall  astahlishad,  Sacond  ordar  control  nay 
inposa  *oad  on  parcaptual  ancodlng^  through  tha  raqulrssnnt  to  axtract  hlghar 
dariaativas  fron  tha  display;  upon  control  proca as ing^  through  tha  incroaaad 
conplaxity  of  updating  an  intamal  nodal  of  tha  dynonic  systan;  and  upon 
raspooaa  procassas,  through  tha  raqulranant  to  ganarsta  altamatiaa  ~hong* 
bong**  rasponsa  prograna. 

In  tha  data  raportad,  tha  aaohad  cortical  potantial  ia  anployad  to  pro* 
aids  a St.  lactiva  indax  of  cha  parcaptual/ancoding  load  inpooad  in  nannal 
ccatrol  of  first  and  sacond  ordar  systano*  This  iodax  of  tha  dagrta  of  load 
turthamora  is  corralatad  on  s trial  by  trial  basis  with  variations  in  para* 
niitars  of  tha  dascribing  funct^  in  ordar  to  indax  its  sansitivity  to  tha 
axtant  of  load  gansration  and  parcaptual  or  notor  noisa. 
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A Model-Based  Technique  for  Predicting  Pilot  Opinion 
Ratings  for  Large  commercial  Transports 


William  Levison 
Bolt  Beranek  and  Newman  Inc. 

SO  Moulton  Street 
Ceuibridge,  NA 

ABSTRACT 

A model-based  technique  for  predicting  pilot  opinion  ratings 
is  described.  Features  of  this  procedure,  which  is  based  on  the 
optimal-control  model  for  pilot/vehicle  systems,  include  (1) 
capability  to  treat  "unconventional*  aircraft  dynamics,  (2)  a 
relatively  free-form  pilot  model,  (3)  a simple  scalar  metric  for 
attentional  %«orkload,  and  (4)  a straightforward  manner  of 
proceeding  from  descriptions  of  the  flight  task  environment  and 
requirements  to  a prediction  of  pilot  opinion  rating.  The  method 
was  able  to  provide  a good  match  to  a set  of  pilot  opinion  ratings 
obtained  in  a manned  simulation  study  of  large  commercial  aircraft 
in  landing  approach. 


INTRODOCTION 

Manufacturers  of  commercial  aircraft  require  more  general  and 
more  reliable  methods  of  predicting  aircraft  handling  qualities 
than  currently  exist.  Existing  criteria  have  been  developed 
primarily  for  military  aircraft  and  have  been  validated  largely  for 
high-performance  aircraft  such  as  fighters.  At  present,  reliable 
techniques  for  extending  existing  criteria  to  large  commercial 
transports  are  not  available. 

This  paper  summarizes  the  results  of  a study  performed  by  Bolt 
Beranek  and  Newman  Inc.  (BBN)  , with  the  aid  of  Douglas  Aircraft 
Company  (Douglas) , to  develop  and  test  a model-based  technique  for 
predicting  the  influence  of  aircraft  response  parameters  and  other 
relevant  factors  on  pilot  opinion  ratings.  While  the  procedure  is 
intended  to  have  general  application,  the  focus  in  this  paper  is  on 
large  transports.  Frequent  reference  is  made  to  a manned 
simulation  study  performed  by  Douglas  in  1975.**  To  facilitate 


^ The  research  described  in  this  paper  was  supported  By  NASA 
Langley  Research  Center  under  Contract  No.  NASl-15529. 

**  This  effort  included  a subcontract  to  Douglas  Company  to  provide 
a data  base  extracted  from  the  1975  Douglas  simulation  study  and 
to  provide  other  consulting  services.  Mr.  William  W.  Rickard  was 
project  engineer  for  the  Douglas  effort. 
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discussion^  the  analytic  study  that  is  the  subject  of  this  paper 
%fill  be  referred  to  as  the  *BBN  study*,  whereas  the  preceding 
siwulation  program  will  be  referred  to  as  the  "Douglas  study*. 
Further  documentation  of  the  BBN  study  is  provided  in  reference  1. 

Vehicle-Centered  Handling  Qualities  Criteria 

Handling  qualities  specifications  are  based  almost  exclusively 
on  open- loop  vehicle  response  character istics^.  Criteria  are 
specified  for  botii  transient  response  and  frequency  response 
characteristics.  Requirements  of  this  sort  allow  the  aircraft 
manufacturer  to  evaluate  aircraft  performance  through  a aeries  of 
relatively  straightforward  in-flight  tests. 

Despite  the  relative  convenience  with  regard  to  compliance 
testing,  application  of  vehicle-centered  handling  qualities 
specifications  to  large  commercial  transports  is  limited  in  a 
number  of  ways.  For  example  (1)  existing  handling  qualities 
criteria  have  been  developed  primarily  for  high-performance 
military  aircraft;  (2)  most  existing  criteria  are  based  on  simple 
models  of  aircraft  dynamics  in  which  phugoid  and  short-period 
response  characteristics  can  be  distinguished  — a condition  not 
necessarily  met  by  aircraft  having  relaxed  static  stability  and 
substantial  control  augmentation;  (3)  turbulence  affects  are 
largely  ignored;  (4)  effects  of  displays  (such  as  flight 
directors),  which  may  influence  overall  mission  suitability,  are 
not  considered;  and  (5)  present  methods  do  not  consider  effects  of 
dynamic  aeroelasticity. 

Hodel-Based  Schemes  for  Predicting  Handling  Qualities 

Pilot/vehicle  analysis  can  allow  considerably  greater  insight 
into  the  handling  qualities  of  an  aircraft  control  system  than  can 
be  obtained  by  analysis  of  open- loop  response,  and  the  demands  made 
on  the  pilot  can  be  explored.  The  effects  of  external  disturbances 
and  control/display  parameters,  as  well  as  inherent  pilot 
limitations,  can  be  considered.  Furthermore,  predictive  schemes 
based  on  pilot/vehicle  analysis  are  not  constrained  to  deal  with 
"conventional*  dynamics  and  are  thus  potentially  more  general  than 
techniques  based  solely  on  open- loop  vehicle  characteristics. 

Until  recently,  application  of  pilot/vehicle  analysis  to 
studies  of  vehicle  handling  qualities  has  been  based  primarily  on 
servo  or  "classical*  control  techniques.  Perhaps  the  most 
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comprehensive  effort  of  this  type  has  been  conducted  by  R.  O. 
Anderson  and  his  associates  in  the  development  of  the  *Paper  Pilot" 
analysis  scheme^*  This  scheme  relates  pilot  rating  to  metrics  of 
both  closed-loop  system  performance  and  pilot  workload,  and  it 
introduces  the  concept  that  the  pilot  operates  so  as  to  minimize 
his  rating  score.  ^ 

Pilot  rating  is  assumed  to  be  an  explicit ’function  of  system 
performance  and  pilot  lead  requirements  (lead  compensation  being 
the  index  of  pilot  workload  in  this  scheme) * A frequency  response 
pilot  model  is  used  in  this  scheme,  and  pilot  parameters  are 
adjusted  to  minimize  pilot  i^ating.  Good  matches  to  experimental 
data  have  been  obtained  for  a variety  of  control  tasks  through 
appropriate  formulation  of  the  rating  expression  and  adjustment  of 
the  relative  weighting  coefficients  associated  with  performance  and 
%<rorkload  (i.e.,  pilot  lead) 

While  the  "Paper  Pilot!*  scheme  realizes  many  of  the  advantages 
of  a model-based  approach,  its  applicability  is  limited  by  lack  of 
general  rules  for  choosing  the  form  of  the  rating  expression  and 
for  quantifying  the  various  weighting  coefficients.  Other  factors 
limiting  the  generality  of  this  and  other  procedures  based  on 
servo-theory  models  include:  (a)  use  of  a relatively  constrained 
fixed- form  pilot  model;  (b)  the  need  to  assume  specific  loop 
closures  prior  to  analysis;  (c)  a cumbersome  treatment  of  pilot 
workload,  especially  when  multiple  loops  are  closed;  and  (d)  the 
inability  to  account  directly  for  factors  related  to  the  perceptual 
environment  (e.g.,  perceptual  resolution  limitations,  whole-body 
motion  cues) . 

More  recently,  Hess^  has  described  a scheme  for  predicting 
pilot  ratings  based  bn  optimal  (or  "modern")  control  theory.  He 
suggests  an  index  of  performance  that  consists  of  a weighted  sum  of 
integral-  (or  mean-)  squared  error  and  control  terms.  "Error"  is  a 
vector  quantity  that  consists  of  the  system  variables  that  the 
pilot  wishes  to  maintain  within  acceptable  limits.  The  pilot  is 
assumed  to  adopt  control  and  estimation  strategies  that  minimize 
this  performance  index. 

Hess  tested  his  scheme  against  19  different  configurations 
covering  a range  of  pilot  ratings.  "Cost"  coefficients  of  the 
quadratic  performance  index  were  chosen  to  match  experimental 
scores,  and  pilot-related  model  parameters  were  chosen  partly  on 
the  basis  of  previous  results  and  partly  to  match  observed 
performance.  Pilot  ratings  could  be  matched  to  within  >1  rating 
unit  by  a linear  relationship  between  pilot  rating  and  the 
logarithm  of  tlie  performance  index.  More  recently,  Fchmidt  has 
used  this  prediction  scheme  as  the  basis  for  a model-based  control 
design  procedure®. 


Although  not  validated  as  a reliable  predictive  tool,  Ress^ 
procedure  lays  the  foundation  for  a scheM  that  seeas  > overcoae 
some  of  the  liaitations  inherent  in  techniques  based  on  classical 
servo  analysis*  The  basic  fora  of  the  perforaance  index  is 
consistent  across  tasks,  the  fora  of  the  pilot  aodel  and  nature  of 
loop  closures  are  deterained  by  the  optiaal  pilot  aodel  and  need 
not  be  specified  by  the  user,  a scalar  aetric  of  workload  is 
provided,  and  factors  related  to  perceptual  environaent  are 
considered* 

Perhaps  the  aoat  severe  liaitation  of  the  optiaal-aodel^based 
approach,  as  developed  so  far,  is  the  requlreaent  to  specify 
nuaerous  task-  and  pilot-related  aodel  paraaeters*  To  soae  extent, 
the  "artistry”  in  specifying  pilot  aodel  foras  and  loop  closures 
for  servo-theory  aodels  is  replaced  by  the  artistry  in  specifying 
paraaeters  (especially  weighting  aatrices)  of  the  optiaal-control 
aodel* 

Another  liaitation,  in  the  opinion  of  this  author,  is  the  lack 
of  a suitable  aetric  for  inforaation-processing  workload*  The 
aetric  proposed  by  Hess  (the  nuaber  of  systea  variables  to  be 
regulated)  does  not  appear  to  add  to  the  rating  scheae  beyond  what 
is  encoapassed  by  the  perforaance  index*  That  is,  if  workload  is 
to  be  real ted  to  controlled  variables  that  are  of  concern  to  the 
pilot,  then  only  those  variables  contributing  significantly  to  the 
perforaance  index  will  increase  pilot  workload*  Such  effects  are 
accounted  for  by  the  nuaeric  value  of  the  index  itself* 

The  methodology  described  in  this  paper  builds  upon  the  work 
of  Hess  and  encompasses  a pilot  rating  prediction  scheae  based  on 
the  optiaal-control  aodel  for  pilot/vehicle  perforaance*  Baphasis 
is  placed  on  the  predictive  aspects  of  the  procedure,  and  a 
rationale  is  offered  for  selecting  aodel  paraaeters  on  the  basis  of 
an  adequate  description  of  the  task  and  in  the  absence  of 
experimental  data*  In  addition,  a well-defined  aodel  parameter  is 
suggested  as  a potential  scalar  workload  aetric  for  the  purposes  of 
predicting  pilot  opinion  ratings* 

Because  pilot  opinion  is  assumed  to  reflect  both  pilot 
workload  requirements  as  well  as  systea  perforaance  capabilities, 
methods  for  predicting  pilot  ratings  should  include  consistent  and 
straightforward  treatments  of  workload* 

The  term  "workload"  is  intended  to  refer  to 
inforaation-processing  — rather  than  physical  — activity  of  the 
pilot.  Specifically,  workload  is  considered  synonymous  with 
"attention"  in  the  remainder  of  this  paper*  Although  attention  is 
not  defined  here  in  a way  that  lends  itself  ;:o  direct  physical 
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measurement,  the  pilot  model  used  in  the  rating  prediction  scheme 
does  include  a parameter  that  can  be  related  to  attention  on  both 
theoretical  and  empirical  grounds.  Thus,  for  the  purposes  of 
obtaining  rating  predictions,  attention  (workload)  is  an 
unambiguous  and  %iorkable  concept* 

METHODOLOGY 


Basic  Approach 

The  prediction  scheme  described  in  this  report  is  based  on  the 
following  assumptions:  (a)  pilot  rating  is  a function  of  the 
flight  task;  (B)  for  a given  flight  task  there  exist  one  or  more 
critical  subtasks  which  serve  as  the  primary  determinants  of  pilot 
rating;  (c)  performance  requirements  are  well  defined  for  each 
critical  subtask;  (d)  pilot  opinion  is  based  partly  on  the  degree 
to  which  desired  performance  is  achieved  and  partly  on  the 
information-processing  workload  associated  with  the  task;  and  (e)  a 
reliable  model  exists  for  predicting  performance/workload  tradeoffs 
for  relevant  flight  tasks* 

These  assumptions  lead  to  the  procedure  diagraunmed  in  Figure 
1.  The  following  steps  are  required  for  predicting  an  average 
pilot  rating  for  a specific  situation. 

1.  Task  Definition.  Pilot  opinion  ratings  are  task  dependent. 
For  example^  the  rating  associated  with  a specific  vehicle, 
relative  to  other  vehicles  or  other  configurations  of  the  same 
basic  airframe,  may  not  be  the  same  in  final  approach  as,  say,  in 
high-altitude  cruise.  Therefore,  separate  assessments  must  be  made 
for  each  flight  task  of  interest. 

Subtask  Definition.  Use  of  the  methodology  requires  a 
quantitative  description  of  the  specific  task  or  subtask  for  which 
predictions  are  to  be  obtained.  For  example,  if  ratings  are 
desired  for  landing  approach,  a critical  aspect  of  that  task  (say, 
ILS  tracking)  must  be  quantified.  Task  specification  requires  a 
linearized  description  of  vehicle  dynamics  plus  a quantitative 
description  of  the  external  environment  (e.g.,  spectral 
characteristics  of  the  wind  gusts  if  the  subtask  is  path  regulation 
in  the  presence  of  zero-mean  random  turbulence) • 

Define  Performance  Criteria.  Performance  criteria  must  be 
defined  IxT  precise  quant ftatfve  terms.  In  order  to  obtain 
performance/workload  predictions  with  the  pilot/vehicle  model  used 
in  this  procedure,  a quadratic  performance  index  containing  error- 
and  control-related  terras  must  be  specified.  The  user  must  specify 
both  the  terms  to  be  included  in  the  performance  index  as  well  as 
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Pl9ur«  I.  Procadur*  for  Pradlctxog  Pilot  Rating 


values  for  the  cost  weighting  coefficients.  Cost  weighting 
coefficients  based  on  assuaed  aaximua  allowable  values  are 
suggested.  As  illustrated  below,  these  coefficients  are  determined 
partly  from  the  physical  constraints  of  the  flight  control  system, 
partly  from  objective  performance  requirements  of  the  closed-loop 
system,  and  partly  from  pilot  preference.  The  performance 
criterion  used  in  the  rating  expression  should  be  a monotonic 
function  of  this  quadratic  performance  index. 

4.  Predict  Performance/Workload  Tradeoff . The  "optimal-control* 
pilot/veTilcle  model,  is  used  to  predict  performance  as  a function  of 
information-processing  workload.  "Workload"-- considered  synonymous 
with  "attention"  in  the  context  of  the  model— is  defined  in  terms 
of  a model  parameter  relating  to  signal/noise  characteristics  of 
the  human  operator. 

^rsdict  Pilot  Rating.  The  results  of  the  preceding  step  arc 
used  in  a fating  exprersion  to  predict  the  pilot  rating.  If 
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experimental  data  are  available  for  the  flight  task/subtask  of 
interest,  a regression  analysis  is  performed  to  ^calibrate”  the 
independent  parameters  of  the  rating  expression;  in  this  case, 
absolute  rating  predictions  are  obtained*  In  the  absence  of  such 
calibration  data,  rating  parameters  are  adjusted  on  the  basis  of 
previous  results,  and  rating  predictions  are  interpreted  on  a 
relative  basis  with  regard  to  predictions  obtained  for  other 
vehicle  configurations* 

Pilot/Vehicle  Model 

The  prediction  technique  described  in  this  paper  is  built 
around  the  so-called  "optimal-control"  model  for  pilot/vehicle 
systems.  The  theoretical  foundation  for  this  model  has  been 
described  in  the  literature,  and  the  model  has  been  validated  for 
both  simple  laboratory  tracking  tasks  as  well  as  for  more  complex 
control  situations*  As  discussed  above,  this  model  has  also  been 
shown  to  yield  good  handling  qualities  predictions^. 

Only  key  features  of  the  model  are  summarized  here.  Readers 
Lnfamiliar  with  the  optimal -control  model  are  directed  to  the 
references  cited  in  Reference  1. 

The  human  operator  is  assumed  to  adopt  strategies  of  state 
estimation  and  control  that  minimize  a scalar  quadratic  performance 
index*  For  airplane  piloting  tasks,  this  performance  index 
consists  of  "error"  terms  relating  to  path,  attitude,  speed,  and 
control  variables*  Pilot-related  limitations  reflected  in  the 
model  include  information-processing  delay,  response  bandwidth 
limitations,  and  limitations  associated  with  attention-sharing  and 
perceptual  resolution. 

Attentional  and  perceptual  limitations  are  accounted  for  by  a 
set  of  "observation  noise*  parair«eters*  Bach  perceptual  variable 
utilized  by  the  pilot  is  assumed  to  be  perturbed  by  a Gaussian 
white  noise  process  linearly  independent  of  other  such  noises  and 
of  external  inputs  to  the  syscem.  In  the  case  of  an  idealized 
single-variable  tracking  task,  the  variance  of  each  observation 
appears  to  scale  with  tha  variance  of  the  associated  perceptual 
variable.  In  this  case,  response  randomness  is  accounted  for  by  a 
noise/signal  ratio*  A more  complex  definition  of  the  observation 
noise  variance  h?s  been  derived  for  situations  in  which  perceptual 
resolution  limitations  are  important^. 

The  model  is  able  to  reproduce  pilot  r^isponse  behavior  in  a 
number  of  simple  laboratory  tracking  tasks  with  a nearly  constant 
value  of  noise/signal  ratio  of  about  0.01  (i*e.,  -20  IB).  The 
consistency  of  this  parameter  across  tasks  and  across  subject 
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populations  suggests  that  it  reflects  a basic  central-*processing 
(rather  than  perceptual  or  motor)  limitation,  and-  these  results 
have  led  to  the  following  model  for  central  attentf.oa  sharing: 


Pi 


1 

f. 


(1) 


where  f^  is  the  fra^^tion  of  attention  devoted  to  the  tracking  task 
as  a whole,  is  the  subfraction  of  such  attention  devoted  to 
display  variable  y^,  and  Po  is  the  baseline  noise/signal  ratio 
associated  with  a high-workload  single-variable  tracking  task 
(typically,  -20  dB) • 

The  attention-sharing  model  of  Eq.  (1)  has  a theoretical 
base^^  and  has  been  validated  in  a study  of  multi-axis  tracking  by 
Levison,  Elkind,  and  Ward^^,  who  found  that  this  model  yielded 
accurate  predictions  of  multi-axis  system  performance.  Hewerinke^^ 
has  also  obtained  generally  good  agreement  between  subjective 
workload  assessments  and  a "irorkload  index*  based  partly  on  this 
model. 


The  model  parameter,  ft#  representing  attention  to  the  control 
task  as  a whole,  serves  as  the  metric  for  workload  in  the  proposed 
handling  qualities  prediction  scheme.  Because  it  is  a scalar 
quantity,  it  mr^y  be  used  in  a straightforward  manner  to  predict 
handling  qualities  for  multi-variable,  multi-axis  flight  control 
tasks.  Unlike  wrn^xoad  metrics  used  in  alternative  model-based 
prediction  schemes,  the  attention  parameter  defined  here  has  a 
theoretical  as  well  as  empirical  basis. 

Because  the  predicted  *cost*  for  a given  task  increases 
monotonically  with  increasing  noise/signal  ratio,  and  because 
noise/signal  ratio  is  related  inversely  to  the  attention  parameter 
f cost  is  a monotonically  decreasing  function  of  *workload*  as  we 
have  defined  it  here.  Thus,  if  other  independent  model  parameters 
are  kept  fixed,  tradeoff  curves  of  performance  versus  workload  can 
be  predicted  for  configurations  of  interest.  As  described  below, 
these  curves  can  be  further  processed  to  yield  predictions  of  pilot 
rating. 

Prediction  of  Pilot  Rating 

In  keeping  with  Anderson^s  philosophy^,  pilot  rating  is 
predicted  by  means  of  a mathematical  expression  that  includes  both 
performance  and  workload  effects.  In  general,  *performance*  is 
defined  in  terms  of  a scalar  function  of  the  signal  deviations 
predicted  by  model  analysis.  As  described  above,  "workload*  is 
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synonymous  with  the  total  attention  to  the  task#  ft*  which  affects 
performance  through  the  noise/signal  ratio. 


Best  results  in  this  study  were  obtained  through  use  of  a 
performance  metric  defined  as  the  joint  probability  of  one  or  more 
system  variables  being  outside  their  respective  "limits”  (i.e., 
maximum  desirable  values) . The  following  alternative  philosophies 
were  tested  and  found  to  yield  good  replications  of  experimentally 
obtained  pilot  ratings:  (1)  pilot  rating  is  determined  by  the 
performance  achievable  at  some  particular  level  of  workload;  (2) 
pilot  rating  is  determined  by  the  workload  required  to  achieve  some 
criterion  level  cf  performance;  and  (3)  pilot  rating  is  a 
continuous  function  of  both  performance  and  workload,  and  the  pilot 
operates  at  a %«orkload  so  as  to  minimize  the  numeric  value  of  his 
rating  (i.e.,  achieve  the  best  ratinq) . 

respectively,  by  the 


(2) 

(3) 

(4) 


These  philosophies  were  implemented, 
following  rating  expressions: 

S 


R • 1 + 9 


R ■ 1 + 9 


S+S, 


|a-Ao 


A-t-A 


S>Sr 


R = 10  [ 


o 

+ 


S+Sq  ^ A+Aq 
1 < R < 10 


where  R is  the  predicted  pilot  rating  on  the  Cooper-Harper  Scale^^; 
S is  predicted  performance  in  terms  of  a probability  as  defined 
above,  A is  the  attention  model  parameter  (equivalent  to  fip  of  Eq. 
(1)),  and  Sq  and  Ao  are  constants  of  the  rating  expressions.*  For 
convenience,  we  shall  refer  to  these  rating  expressions  as  the 
"performance  model”,  the  "attention  model",  and  the  "minimum-rating 
model". 

The  first  two  expressions  are  intended  as  predictors  of  rating 
only,  not  as  predictors  of  the  specific  point  on  the 
performance-workload  tradeoff  curve  at  which  the  pilot  will 
operate.  The  minimum-rating  expression  of  Eq.  (4) , on  the  other 
hand,  embodies  the  notion  expressed  by  Anderson  that  the  pilot 
trades  between  performance  and  workload  in  such  a way  as  to 
minimize  the  rating  score.  In  principle,  use  of  the  minimum-rating 
expression  should  allow  one  to  predict  pilot  workload  nd  overall 
system  performance  as  well  as  the  pilot  rating. 


* Numerical  values  for  Aq  and  Sq  vary  from  one  expression  to 
the  next. 
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DATA  BASE 


The  data  base  used  for  developing  and  testing  the  handling 
qualities  prediction  scheme  was  obtained  from  two  sources:  (1)  an 
experimental  study  performed  by  Douglas  Aircraft  Company  in  1975^^, 
and  (2)  the  results  of  a questionnaire,  submitted  during  the  course 
of  this  study,  to  the  test  pilots  who  participated  in  the  Douglas 
study. 

Description  of  Experiments 

A manned  simulation  study  was  conducted  by  Douglas  to  explore 
the  applicability  of  various  handling  qualities  criteria  to 
longitudinal  flying  (qualities  of  large  tra  sport  aircraft  in  the 
landing  approach.  Criteria  that  were  evaluated  included  several 
vehicle-centered  criteria  from  MII#-P-8785B^,  vehicle-centered 
criteria  from  other  sources^^,  and  a pitch  tracking  criterion 
involving  a closed- loop  pilot  model^.  This  study  is  described  in 
detail  by  Rickard^^;  a summary  of  the  experiments  is  given  below. 

The  Douglas  study  explored  a total  of  42  vehicle 
configurations*  The  first  group  of  26  configurations  were  obtained 
by  selecting  stability  derivatives  typical  of  wide-body  aircraft 
and  either  varying  the  simulated  eg  location  from  far  forward  to 
far  aft  of  the  neutral  point,  or  by  varying  a single  stability 
derivative.  Configurations  of  the  second  group  were  obtained  by 
specifying  vehicle  frequency-response  characteristics  and  then 
solving  for  the  stability  derivatives.  All  handling-qualities 
variations  were  confined  to  the  longitudinal  control  axis? 
lateral-directional  a^*oraft  parameters  were  icept  fixed  throughout 
the  experiment  to  pr  j.de  response  characteristics  typical  of  a 
wide  body  transport. 

Five  Douglas  test  pilots  performed  evaluations  of  these 
configurations  on  a six-degree-of-freedom  moving-base  simulator. 
Each  evaluation  typically  consisted  of  two  ILS  approaches:  the 
first  performed  in  the  absence  of  simulated  atmospheric 
disturbances,  the  second  in  the  presence  of  simulated  zero-mean 
turbulence.  Approach  was  initiated  at  a range  of  7.4  n.  mi.  from 
runway  threshold  at  an  altitude  of  1500  feet  on  the  extended  runway 
center  line.  The  3-degree  glide  slope  was  intercepted  at  a range 
of  about  4.7  n*  mi.;  the  pilot  flew  down  the  glide  slope  relying 
on  ILS  instrumentation  for  path  information  to  an  altitude  of  about 
700  feet,  at  which  point  the  pilot  transitioned  to  a visual  display 
for  flare  and  touchdown. 

The  test  pilots  were  encouraged,  in  general,  to  perform 
maneuvers  that  would  aid  in  their  evaluations  (e.g.,  intentionally 
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impose  and  then  eliminate  a path  or  attitude  error)  9 but  no 
specific  set  of  maneuvers  was  required.  A single  Cooper-Harper 
rating  was  given  by  each  pilot  for  the  pair  of  still-air  and 
turbulent-air  approaches  for  each  configuration*  Some 
configurations  were  evaluated  more  than  once  by  some  of  the  test 
pilots.  Evaluations  were  performed  on  the  basis  of  approach 
performance  only;  flare  and  touchdown  characteristics  were  not 
considered. 

Configurations  Explored  in  the  BBN  Study 

The  rating  expression  described  in  Eq.  (2)  - (4)  were  tested 
against  eight  configurations  selected  from  the  first  group  used  in 
the  Douglas  study.  Three  configurations  were  chosen  to  span  a 
range  of  pilot  ratings  as  well  as  a range  of  handling  qualities 
problems*  Modal  characteristics  for  the  configurations  explo'^ed  in 
the  BBN  study  are  given  in  Table  1. 

The  test  pilots  were  assumed  to  utilize  the  ILS  instrumentf 
attitude  indicator,  and  airspeed  indicator  as  their  primary 
displays  during  the  instrument-flight  portion  of  the  simulated 
approach. 

Zero-mean  turbulence  was  simulated  in  the  three  linear  and 
three  rotational  degrees  of  freedom  in  the  Douglas  study. 
Turbulence  models  (based  on  models  suggested  in  the  flying 
qualities  specifications^)  were  used  to  provide  disturbances  to 
longitudinal-axis  variables.  RMS  u-  and  w-  gust  levels  were  fixed 
at  7.8  ft/sec  and  6.5  ft/sec,  respectively.  Further  details  on 
these  gust  models  are  given  in  reference  1. 

Performance  Requirements 

Application  of  the  prediction  scheme  described  above  requires 
that  one  or  more  specific  subtasks  be  selected  for  analysis  and 
that  performance  requirements  be  specified  for  each  subtask.  To 
obtain  this  information,  a questionnaire  was  prepared  by  BBN  and 
administered  by  Douglas  personnel  to  4 of  the  5 test  pilots  that 
had  participated  in  the  1975  manned  simulation  study.  Through  this 
questionnaire  the  pilots  were  requested  to  (1)  state  whether  or  not 
pilot  ratings  were  determined  primarily  by  longitudinal  handling 
characteristics;  (2)  specify  whether  ratings  were  based  mainly  on 
the  instrument-flight  portions  of  the  approach;  (3)  specify  In 
order  of  priority,  the  subtasks  that  were  important  determinants  of 
pilot  rating;  and  (4)  specify  in  as  quantitative  manner  as  possible 
the  **de8ired"  and  "acceptable”  levels  of  performance  for  each 
subtask.  A sample  of  the  questionnaire  is  provided  in  reference  1. 
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TABLE  I 


Configuration  Ctiaractariatics 
V - 140  kcs  Y • -3°  wc  - 3SO.OOO  lbs 


Conflf.* 

^uabsr 

or 

Hi 

1 

0.S46 

0.628 

0.186 

0.072 

3.80 

-0.00 

-0.C84 

-0.S06 

J 

(-0.633) 

(-0.307) 

0.086 

0.3X8 

4.14 

-0.049 

-0.082 

-0.556 

4 

(-0.8U) 

(«H).090) 

0.200 

0.363 

4.20 

-0.051 

-0.082 

-0.364 

5 

(-0.909) 

(+0.158) 

0.184 

0.210 

4.24 

-0.053 

-0.082  1 

-0.568 

3 

0.811 

0.662 

0-X94 

0.041 

3.80 

-0.324 

+0.041 

-0.631 

13 

(-0.991) 

(+0.225) 

0.2X1 

0.388 

4.29 

-0.055 

-0.082 

-0  575 

16 

(-1.061) 

(+0.291) 

0.2X0 

0.331 

4.35 

-0.057 

t -0.082 

-0.583 

2X 

0.441  j 

0.665 

1 

0.170 

0.04: 

1.05 

-0.285  1 

1 (0.1491 

(0.6761 

• snort^poriod  natural  fraquancy,  rad/»ac 

• •hon.-pariod  danptag  ratio 

• i»au%oid  natural  £raquaacy«  cad/aac 

; . • phugoid  damping  ratio 
PP 

n/:i  • noroaX  accalaration  par  amt  sngla  of  attack, 
g/rad 

dr/dV  • pa'h  angla  chan^a  par  apaad  changa,  dag/kc 

• numarator  cima  constant,  sac 


( ) iignifiaa  fir»t-ord-»r  factor 


• Configuration  numOar  of  tha  Ooun-  n Study  {25] . 


All  four  pilots  agreed  that  lateral -directional  handling 
qualities  were  quite  satisfactory  and  that  pilot  ratings  were 
influenced  primarily  by  longitudinal  handling  characteristics. 
They  all  stated  that  the  instrument-flight  phase  was  more  important 
in  determining  ratings. 

All  subjects  indicated  at  least  three  subtasks  as  important 
determinants  of  pilot  rating.  Relative  importance  of  these 
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subtasks  fo  he  subject  population  as  a whole  was  determined  from 
•priority  . computed  by  assigning  5 •points*  to  an  item 
receiving  highest  priority,  4 points  to  the  next  priority,  and  so 
on  to  1 point  for  tasks  ranked  fifth  or  more  in  the  list.  Priority 
scores  for  each  task  are  shown  in  Table  2,  along  with  the  total 
score  obtained  by  summing  across  pilots. 


Table  2 


Priority  Scores  for  iBportsnt  SubtsslLs 


Priority  Score 

Subtask 

LB 

BM 

JM 

AT 

Total  1 

Glid*-Slop^  Capture 

5 

5 

4 

4 

IS 

GXida-Slope  Trackirq 

4 

- 

2 

5 

11 

Recover  froa  Olida  Slop*  Mistrxji 

3 

3 

I 

4 

11 

Altituda  Station- Keep  me 

- 

4 

S 

- 

3 

Open- loop  Response 

- 

2 

3 

3 

• 

Recover  frc»  Airspeed  nistriai  { 

2 

- 

1 

- 

3 

Recover  trom  Pitch  Hx»trim 

— 

- 

— 

1 

Table  2 shows  that  ratings  were  largely  determined  by  the 
ability  of  the  pilot  to  regulate  path  error.  Highest  priority  was 
given  to  tasks  involving  transient  maneuvering  (glide*slope 
capture,  correcting  self-induced  height  error)  • Next  in  importance 
were  casks  requiring  continuous  regulation  of  height  error 
(altitude  station-keeping  prior  to  glide  slope  acquisition, 
post-acquisition  glide-slope  tracking) . Open  loop  response  and 
correction  of  pitch  and  airspeed  mistrim  were  of  substantially  less 
importance  overall  in  terms  of  influencing  pilot  opinion. 

Obtaining  quantitative  comments  related  to  performance 
requirements  was  considerably  more  difficult  than  anticipated. 
Only  t«ro  of  the  four  pilots  provided  quantitative  responses,  and 
only  one  of  these  (Subject  JM)  differentiated  between  "desired"  and 
•acceptable"  performance. ♦ Performance  requirements  indicated  by 
these  two  subjects  for  tasks  requiring  continuous  regulation  a*e 
given  in  Table  3. 


^ To  aI3  tfie  pilot  Tn  making  ETus  distinction,  Adequate" 
performance  was  defined  in  the  questionnaire  as  corresponding  to 
the  boundary  between  a rating  of  6 and  7,  whereas  "desired" 
performance  was  to  be  associated  with  a rating  of  1. 
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Table  3 
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•t  200* 
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♦ 100  ft. 

♦ 1/4  dot 
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At  uoo* 

♦ I/O  Sot 
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. _ _ 1 
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t 

t ^ 

- 

XlrspooO  Error 

Oojatsi 

! 

1 

♦ 10  j 

♦ 2 

1 * 1 

i 

- 5.  ♦ 10 

Pilot  Ratings 

Hean  and  standard  deviations  of  the  pilot  ratings  obtained  in 
the  Douglas  study  are  given  in  Table  4,  along  with  handling 
qualities  levels  as  deti  rained  fro*  two  of  the  vehicle^centered 
criteria  considered  by  Rickard.  Rating  statistics  were  derived  by 
first  averaging  multiple  ratings  (where  such  existed)  for  each 
pilot  for  each  configuration,  and  then  using  these  averages  to 
compute  a mean  and  standard  deviation  across  subjects  for  each 
configuration.*  Table  4 shows  both  a wide  spread  of  average  pilot 
ratings  across  the  configurations  explored  in  the  BBN  study  as  well 
as  a variety  o'  handling  qualities  problems.  The  short*period 
response  criterion  predicts  adverse  handling  qualities  for  five  of 
the  configurations  — four  of  which  exhibit  static  instability. 
Two  of  the  remaining  configurations,  on  the  other  hand,  exhibit 
adverse  flight  path  stability  (dT/dV) . 

TEST  OF  METHODOLOGY 

The  prediction  scheme  described  above  and  diagrammed  in  Figure 
1 was  applied  to  the  data  base  obtained  in  the  1975  Douglas  study. 
In  order  to  apply  this  scheme,  twenty  independent  model  parameters 
had  to  be  specified.  As  the  following  discussion  demonstrates, 
eighteen,  of  these  parameters  were  defined  largely  cn  the  basis  of 
task  analysis,  tempered  by  some  engineering  judgement.  Once 
selected,  three  parameter  values  were  held  fixed  throughout  the 
analysis:  only  the  two  parameters  of  the  rating  expression  were 
adjusted  to  match  experimental  data. 


*^^atings  shorn  for  configurations  4 and  Sniffer  slightly  trom 
those  presented  by  Rickard,  who  computed  the  mean  of  all  ratings 
pertaining  to  a given  configuration  regardless  of  the  number  of 
evaluations  per  pilot. 
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Tabl<>  4 

^ilot  Optni^ofi  IUtXQ9« 


1 Pilot  t 
Conf 19. 1 Waan 

Rating 
SO  j 

dy/dV 

1 

i v«.  n/a 

Laval 

Static 

Stability 

1 !’■* 

1-S 

1 

1 1 

Ya* 

i 4.J 

2.3 

1 

4 1 

Yas 

4 1 4.2 

2.1 

1 

NO 

5 S.3 

1.4  1 

1 1 

No 

S 1 •.} 

2.1 

4 

1 1 

Taa 

15  j 

l.S 

1 

4 

NO 

14  7.7 

2.5 

1 

4 

Mo 

21  4.2 

5.5 

4 

2 

Yaa 

MMn  ratxnq  for  5 
ftMn  r«tin9  for  J 


pilots,  configurations  1.2. 4. 5 
pilots,  configurations  3. IS. 1C. 21 


Problem  Definition 


The  methodology  described  in  this  paper  was  applied  to  the 
general  flight  task  of  final  approach,  exclusive  of  landing*  On 
the  basis  of  the  questionnaire  submitted  to  the  Douglas  test 
pilots,  two  specific  subtasks  were  initially  selected  for  study: 
continuous  glide-slope  tracking  in  turbulence,  and  recovery  from 
intentional  glide-slope  offset*  Preliminary  exploration  of  the 
latter  (transient)  task  was  performed,  but  resources  permitted  a 
complete  analysis  of  only  the  continuous  tracking  task*  Therefore, 
discussion  is  confined  to  tests  based  on  the  continuous  tracking 
task. 


Although  continuous  in  nature,  glide-slope  tracking  following 
capture  is  not,  strictly  speaking,  a steady-state  task  because  of 
time  variations  in  various  task  parameters*  For  example  (a) 
turbulence  bandwidth  changes  with  altitude;  (b)  path  control 
becomes  more  important  as  the  touchdown  point  is  approached;  and 
(c)  since  the  ILS  instrusient  displays  path  error  in  terms  of 
angular  deviation,  the  effective  display  gain  (inches  of  indicator 
deflection  per  foot  of  height  error)  also  varies  with  range. 
Nevertheless,  oecause  these  time  variations  are  slow  compared  to 
the  time  constants  of  important  system  variables, 
piecewise-steady-state  analysis  can  yield  meaningful  predictions  of 
pilot/vehicle  performance  at  various  points  along  the  glide  path. 

A *"frozen-point”  analysis  was  performed  at  a simulated 
altitude  of  1000  feet*  Parameters  of  the  turbulence  model 
appropriate  to  this  altitude  (see  reference  1)  were  chosen  for  this 
analysis. 

Weighting  coefficients  for  the  quadratic  performance  index 
given  in  Eq*  (I)  were  selected  as  the  reciprocals  of  the  maximum 
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allowable  deviations  (or  "Units*)  on  inportant  system  variables  — 
a procedure  that  has  been  followed  with  apparent  success  in 
previous  applications  of  the  opti»al*control  pilot  nodel.^^^^ 
Linits  of  117  ft*  height  error  (corresponding  to  1 dot  glide-slope 
deviation  at  an  altitude  of  1000  ft.)  and  10  lets  (16.9  ft/sec) 
airspeed  error  were  chosen  on  the  basis  of  pilot  co—entary 
summarized  in  Table  3*  Limits  of  40  pounds  stick  force  (10  degrees 
elevator  deflection),  60  pounds/sec  force  rate,  and  21,500  pounds 
thrust  %iere  chosen,  in  part,  on  the  basis  of  physical  constraints 
of  the  control  system.  A limit  of  10,750  pounds/sec  rate  of  change 
of  thrust  was  chosen  to  induce  a control-related  lag  time  constant 
of  about  2 sec;  this  selection  was  based  on  the  assumption  that  the 
pilot  t#ould  not  make  continuous  wide-band  throttle  movements  during 
approach. 

No  limits  (i.e.,  no  terms  in  the  quadratic  performance  index) 
were  associated  with  either  sinkrate  error  or  attitude  variables. 
Penalties  on  attitude  variables  were  omitted  because  no  limitations 
on  such  variables  were  specified  by  the  test  pilot;  sinkrate  error 
was  omitted  from  the  performance  index  to  prevent  overemphasis  on 
height-related  variables.  Despite  the  lack  of  explicit  performance 
penalties  on  attitude  variables,  the  penalties  on  control-related 
variables  constrained  the  model  to  predict  a reasonable  "mix*  of 
height,  attitude,  and  control  deviations. 

The  pilots  were  assursed  to  make  longitudinal-axis 
flight-control  inputs  primarily  on  the  basis  of  perceptual 
information  obtained  from  the  ILS,  attitude,  and  airspeed 
instruments.  Rate  information  was  also  assumed  to  be  obtained  from 
the  ILS  and  attitude  indicators.  Thus,  the  "display  vector" 
assumed  for  model  analysis  consisted  of  height,  sinkrate,  pitch, 
pitch  rate,  and  airspeed  errors. 

Attention  was  assumed  to  be  divided  equally  between  the  ILS, 
attitude,  and  airspeed  instruments;  no  attention-sharing  penalties 
were  considered  between  displacement  and  rate  information  from  the 
same  physical  display.  On  the  basis  of  analjfsis  performed  in  a 
previous  analytic  study  of  landing  approach, 34%  of  the  pilot's 
attention  was  assumed  to  be  "lost*  because  of  large  eye  movements 
required  to  scan  the  flight-control  instruments.  Thus,  fractional 
attentions  of  0.22  were  associated  with  the  ILS,  attitude,  and 
airspeed  displays. 

Effective  perceptual  thresholds  were  computed  from  the  display 
gains  (i.e.,  inches  of  display  deflection  per  unit  change  in 
problem  variable),  the  eye-to-di splay  distance,  and  assumed  values 
of  perceptual  resolution  limitations  based  on  previous  laboratory 
experiments  as  described  by  Levison.^  A residual  noise  was  also 
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associated  with  perception  of  pitch  attitude  change.  Display  and 
performance-related  model  parameters  are  given  in  Table  5. 


Tabl«  ^ 

Display-  «nd  :ioc«I  ?^r»a«c«r9 


Van  bl« 
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1 
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a 
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*• 

40 
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- 

- 

- 

1 

6 

• 1 

60 
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- 

- 

‘t 
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1 

- 

- 

10.750 

8.65  E-09 

\ 

\ ' 1 

- 

- 

h • altxtudtt  •r'^r.  fMC 
3 - pitch  Chang* , d*gr*«s 
q • pitch  rat«»  d*gr*«s/t*oond 

- airspMd  raiativ*  to  aoving  air  aas*«  £**t/s*conJ 
5^  • Sore*  on  th*  control  colvjcsi,  poencs 
• thrust  daviation  Iron  trim,  tounda 


Additional  pilot-related  model  parameters  — not  shown  in  the 
table  — were  (a)  an  observation  noise/signal  ratio  of  -20  dB 
associated  with  a relative  attention  of  unity,  (b)  a motor  noise/ 
signal  ratio  of  -60  dB,  and  (c)  a time  delay  of  0.2  seconds. 
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Prediction  of  Per  for  nance /Workload  Tradeoffs 

Performance/workload  tradeoffs  were  predicted  for  each  of  the 
eight  configurations  defined  in  Table  1.  For  purposes  of 
predicting  handling  qualities,  "performance”  was  defined  as  the 
probability  of  one  or  more  system  variables  exceeding  maximum 
allowable  values.  To  obtain  an  approximation  to  this  joint 
probability,  system  variables  were  treated  as  independent  Gaussian 
var iables. 


(5) 

where  Pr^  is  the  probability  that  the  i^^  variables  of  interest 
will  lie  outside  its  prescribed  boundary,  and  Pr  is  the  probability 
that  ct  least  one  such  variable  is  out  of  bounds.  The  probability 
Pri  was  readily  computed  from  the  predicted  variance  of  the  i^" 
system  variable.  (Since  we  considered  steady-state  conditions,  all 
variables  were  assumed  to  be  sero-mean  Gaussian  processes.) 
"Horkload*  was  represented  in  the  analysis  by  the  attentional 
variable  f^;  the  were  adjusted  to  reflect  attention-sharing  as 
shown  in  Table  5.  A noise/signal  ratio  P • 0.01  was  associated 
with  a relative  attention  of  unity.  Thus,  variations  in 
attentional  workload  mre  reflected  by  changed  in  the  noise/signal 
ratios  according  to  Bq.  (1) • 

Predictions  of  performance  versus  attentional  %rorkload  are 
shown  in  Figure  2 for  the  eight  configurations  explored  in  the  BBM 
study.  Values  of  attention  shown  on  the  abscissa  are  relative  to 
that  inferred  from  data  obtained  in  a standardized  laboratory 
tracking  task.  That  is,  unity  attention  is  intended  as  a benchmark 
level  of  workload  and  does  not  necessarily  relate  to  maximum  effort 
of  capability.  Thus,  for  configurations  in  which  predicted 
performance  is  especially  sensitive  to  attention,  predictions  are 
shown  for  relative  attentions  greater  than  unity. 

The  trends  shown  in  Figure  2 are  consistent  with  the  pilot 
ratings  given  in  Table  4.  Except  for  configuration  8,  the  ordering 
of  the  per formanc^: /workload  curves  is  consistent  with  the  ordering 
of  the  pilot  ratings.  For  attentions  of  0.5  and  greater,  predicted 
performance  for  the  remaining  seven  configurations  follows  the 
trend  of  the  ratings.  Operation  on  these  results  to  yield 
predicted  pilot  ratings  is  discussed  below. 
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rigt  *•  2.  Prediction  of  Perforaenc*  ver»t?e  -Jorkloed 


Predicted  Ratings 

The  three  rating  expressions  presented  in  Bqns.  (2-4)  were 
applied  to  the  per formance /workload  tradeoff  curves  to  provide  a 
test  of  the  proposed  methodology.  Values  were  assigned  to  the 
independent  parameters  of  each  expression  as  shown  below  in  Table 
6. 


The  value  of  ho  of  the  performance  model  was  chosen  to 
represent  a moderate-to-high  workload  levels  and  the  corresponding 
value  for  Sq  was  found  through  a regression  procedure  that 
minimized  the  mean-squared  difference  between  predicted  and 
experimental  pilot  ratings^  normalized  with  respect  to  the  variance 
of  each  experimental  rating.  The  value  for  Sq  of  the  attention 
model  was  selected  to  represent  a moderate-to-stringent  performance 
requirement^  end  the  value  for  ho  was  found  through  a similar 
regression  analysis. 
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Table  6 

Independent  Parameters  for  the  Rating  Expression 


Expression 

A 

Performance  Model 

5.3% 

0.50 

Attention  Model 

5.0% 

0.47 

Minimum- rating  Model 

10.0% 

2.0 

Because  of  the  lack  of  a tractable  analytic  expression 
relating  performance  to  %iorkload7  the  parameters  Sq  ^nd  of  the 
minimum-rating  model  were  not  found  through  a computerised 
regression  analysis.  Rather#  pairs  of  integers  were  explored  on  a 
tr ial-and-error  basis  to  provide  a good  match  to  experimental  pilot 
ratings.  The  predicted  (minimum)  rating  for  a given  configuration 
was  obtained  by  superimposing  the  predicted  performance/workload 
tradeoff  curve  (Figure  2)  on  the  curves  of  constant  rating,  shown 
in  Figure  3* 

Because  of  the  difficulty  in  matching  the  predicted  pilot 
ratings  of  Configuration  8,  ratings  for  this  configuration  were 
omitted  from  all  three  regression  analyses. 

Figure  4 provides  a graphicc.  comparison  of  predicted  versus 
experimental  pilot  ratings  for  the  three  rating  expressions. 
Dashed  lines  indicate  boundaries  of  1 rating  unit.  The  three 
rating  schemes  performed  about  equally  well  on  the  average  and  were 
. )le  to  match  6 of  the  8 experimental  ratings  to  within  one  rating 
unit.  The  configuration  matched  least  well  was  Configuration  8, 
which  was  omitted  from  the  regression  analysis. 

Prediction  errors  may  be  compared  against  the  variability  of 
the  experimental  data  in  Figure  S.  Experimental  ratings  are 
indicated  by  filled  circles,  with  brackets  to  indicate  1 standard 
deviation;  open  symbols  indicate  predictions  obtained  with  the 
three  rating  expressions. 

Except  for  Configuration  8,  predicted  ratings  are  within  one 
standard  deviation  of  the  experimental  mean*  Even  for  the  worst 
case,  the  prediction  error  is  well  within  two  standard  deviations 
of  the  mean.  Thus,  the  reliability  of  the  predicted  ratings  is 
commensurate  with  the  reliability  f the  experimental  data. 
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Discussion  of  Results 


The  generally  good  match  between  "predicted*  and  experimental 
pilot  opinion  ratings  demonstrates  the  validity  of  the  model«-based 
approach  described  in  this  paper.  The  technique  is  shown  to 
replicate  experimental  results  reasonably  well  across  a set  of 
conditions  that  spans  a range  of  handling  qualities  levels  and 
problems.  Because  the  procedure  is  based  on  a pllot/vehicle  model 
of  considerable  generality  and  demonstrated  validity,  this  scheme 
ought  to  be  valid  for  other  aircraft  configurations  and  , with 
appropriate  definitions  of  performance  requirements,  ocher  flight 
tasks  as  well.  Further  study  is  required  to  compare  the  BBN 
techniques  against  other  model-based  procedures  and  to  further 
compare  the  usefulness  of  the  three  rating  expressions  tested  in 
this  study. 

Resources  did  not  permit  a detailed  study  of  the  inability  to 
obtain  a good  match  to  the  experimental  rating  for  Configuration  8. 
The  differences  between  the  average  ratings  for  Configurations  8 
and  21  (which  our  prediction  scheme  predicts  to  be  negligible)  were 
apparently  not  due  to  training  effects;  these  two  configurations 
were  presented  to  the  test  pilots  in  a balanced  order. 

It  should  be  noted  that  all  tests  of  the  proposed  methodology 
have  been  based  on  steady-state  analysis  appropriate  to  conditions 
at  a single  altitude.  Although  steady-state-like  tasks  were 
important  determinants  of  pilot  opinion,  transient-response 
behavior  was  also  important.  There  may  have  been  some  aspects  of 
glide-slope  capture  and  other  transient  maneuvers  that  were 
es:>ecially  adverse  for  Configuration  8.  Additionally,  it  is 
possible  that  a different  choice  of  steady-state  pareuneters  (e.g., 
turbulence  appropriate  to  a lower  altitude,  different  "limits”  on 
throttle  response)  may  have  differentiated  between  Configuration  8 
and  21. 

Data  from  the  Douglas  experiments  were  used  in  the  BBN  study 
because  of  their  applicability  to  large  transports.  Because  the 
experimental  study  was  performed  well  before  the  BBN  analytical 
study,  the  Douglas  effort  was  not  designed  to  allow  a thorough  test 
of  the  model-based  prediction  to  scheme.  Hindsight  reveals  the 
following  methodological  deficiencies: 

1.  Sparcity  of  Performance  Measurements.  Pilot  opinion  ratings 
were  the  only  data  put! i shed  relating  to^losed-loop  pilot/vehicle 
performance.  Objective  performance  measures  such  as  rms  errors, 
pilot  describing  functions,  spectra,  or  time  histories  are  not 
available.  Thus,  we  cannot  determine  the  pilot^s  "operating  point" 
in  terms  pilot-related  model  parameters,  and  we  cannot  verify  the 
ability  of  the  model  to  predict  objective  performance  measures. 
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2.  Large  Rating  Variability,  Standard  deviations  for  pilot 
ratings,  as  3et«mined  across  subjects,  were  relatively  large, 
reaching  a maximum  of  3.5 • Clearly,  large  variability  in  the  data 
hinders  a rigorous  test  of  the  prediction  scheme.  To  some  extent, 
the  large  standard  deviations  resulted  from  a small  subject 
population  (only  3 subjects  provided  ratings  for  4 of  the 
configurations  explored  in  the  BBM  study).  As  described  below,  a 
more  significant  factor  may  have  been  an  insufficiently  specific 
evaluation  procedure. 

3.  Insuff icxently  Specific  Evaluation  Procedure.  Typically,  each 
pilot  was  allowed  two  "flints"  per  configuration:  an  initial 
flight  without  turbulence,  and  a follcw-up  flight  with  moderate 
turbulence.  The  pilots  were  encouraged  to  perform  maneuvers  that 
would  aid  in  developing  their  rating,  and  they  were  asked  for  a 
single  overall  rating  of  the  configuration  of  the  end  of  the  two 
slights.  While  all  subjects  appeared  to  consider  the  same  basic 
maneuvers  and  subtasks  (glide«*slope  capture,  glide-slope  tracking, 
recover  from  mistrim,  open-loop  vehicle  response),  we  do  not  knew 
the  extent  to  which  each  pilot  weighted  the  various  response 
categories.  Different  weightings  might  have  led  to  different 
ratings  for  the  same  configuration  — a possible  explanation  for 
the  large  pilot-to-pilot  variability  observed  in  this  study. 
Differences  in  the  pilot's  expectations  of  system  performance  are 
another  potential  source  of  rating  variability. 

Consideration  of  these  methodological  shortcomings  suggests 
alternative  approaches  in  future  studies,  as  outlined  below. 


CONCLUSIONS  AND  RECOMMENDATIONS 

A technique  based  on  the  optimal-control  model  for 
pilot/vehicle  systems  has  been  developed  for  predicting  pilot 
opinion  ratings.  Three  variations  of  this  technique  provide  a good 
match  to  opinion  ratings  obtained  in  a manned  simulation  study  of 
large  commercial  transports  in  landing  approach. 

The  model-based  technique  developed  in  this  study  has  a number 
of  features  which  should  enhance  its  applicability  to  other 
aircraft  configurations  and  other  flight  tasks  and  should  allow 
wider  application  than  alternative  handling  qualities  prediction 
schemes: 

1.  One  is  able  to  proceed  in  a straightforward  manner  from  a 
description  of  the  task  environment  and  of  task  requirements  to  a 
prediction  of  pilot  opinion  ratings.  The  general  form  of  the 
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rating  expression  and  of  the  underlying  pilot  model  is  invariant 
across  applications. 

2.  No  constraints  are  placed  on  the  nature  of  vha  vehicle  response 
and  the  pilot  model  is  relatively  free  form*  Thus# 
"unconventional"  aircraft  dynamics  may  be  considered. 

3.  A scalar  metric  for  attentional  workload  is  expressed  in  terms 
of  a model  parameter  related  to  the  signal/noise  properties  of  the 
pilots  response.  Thus,  the  treatment  of  workload  is  independent 
of  the  details  of  the  flight  task. 

4.  The  effects  of  display  parameters,  turbulence,  and  other 
environmental  factors  on  pilot  opinion  rating  are  readily 
considered. 

Encouraging  results  obtained  with  the  model-based  technique 
tested  in  this  study  warrant  further  research  to  provide  a more 
rigorous  test  of  the  procedure  and  to  determine  its  range  of 
validity.  Such  a study  should  be  subjected  to  the  following 
guidelines: 

1.  Flight  Test  Standardization.  The  flight  tests  performed  for 
the  purpose  oT^  obtaining  pilot  opinion  ratings  should  be 
standardized  so  that  all  pilots  perform  the  same  maneuvers  on  the 
aircraft.  Either  separate  ratings  should  be  obtained  for 
individual  maneuvers,  or  cax  ^ should  be  taken  to  assure  that  all 
pilots  weight  the  various  maneuvers  in  the  same  manner  when 
assigning  an  overall  rating  to  the  aircraft. 

2.  Define  Performance  Criteria.  Through  a carefully  prepared  and 
admin istereJ  questionnaire,  subjective  performance  criteria  should 
be  determined  for  th  various  test  maneuvers.  If  practlcai,  test 
pilots  should  be  encouraged  to  adopt  a common  set  of  criteria  to 
minimize  rating  variability. 

3.  Performance  Measurement.  Objective  measures  of  system 
performance  and  pilot  response  behavior  should  be  obtained,  in 
addition  to  pilot  opinion  ratings,  to  provide  a more  rigorous  test 
of  the  method. 
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ABSTRACT 


In  order  to  analytically  predict  pilot  ratings  an  evaluation  sethod  of 
a manual  control  system  which  consists  of  an  aircraft  and  a human  pilot,  is 
proposed  and  examined.  The  method  is  constructed  upon  the  assumptions  that 
the  control  mission  determines  the  critical  frequency  the  pilot  should  bring 
to  his  focus,  and  that  the  degree  of  closed- loop  stability  and  the  human 
compensation  necessary  to  attain  the  stability  determine  the  human  subjective 
evaluation  of  the  system*  As  a result,  a simple  evaluation  chart  is  intro- 
duced. The  chart  enables  us  to  predict  the  subjective  evaluation,  if  the 
controlled  element  dynamics  and  the  mission  are  given*  The  chart  is  in  good 
accord  with  almost  all  of  the  existing  results  of  pilot  ratings.  This  method 
has  the  following  four  advantages:  (i)  Simplicity,  in  a sense  that  the  method 
needs  to  evalxiate  only  two  typical  controlled  element  parameters,  namely,  the 
gain  slope  and  the  phase  at  the  critical  control  trequency;  (ii)  Applicability 
to  unstable  controlled  elements;  (iii)  Predictability  of  controllability 
limits  of  manual  control;  (iv)  Possibility  of  estimating  human  compensatory 
dynamics . 


INTRODGCTIW 


In  recent  years,  handling  quality  criteria  of  aircraft  have  been  influ- 
enced by  rapid  development  of  the  automatic  flight  control  system*  Newly 
developed  flight  control  system  enables  aircraft  to  be  designed  with  any 
handling  characteristics.  Aircraft  with  those  flight  control  systems  are 
sometimes  called  higher  order  system  (HOS) , the  response  of  which  doesn’t 
indicate  significant  short  period  mode  any  more.  Urged  by  thus  obtained 
increase  of  degrees  of  freedom  in  designing  aircraft  handling  characteristics, 
revisions  the  handling  quality  criteria  have  been  proposed^*^. 

These  re  ions,  however,  have  the  following  common  problems:  (1)  There  is  no 
direct  relationship  between  the  criteria  and  the  human  pilot  models;  (2)  To 
measure  gain  or  phase  characteristics,  careful  attention  is  needed.  If 
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measured  frequencies  differ,  the  result  becomes  quite  different* 

The  objective  of  this  paper  is  to  propose  and  examine  an  improved  method 
to  perdict  pilot  ratings,  which  fully  utilizes  human  pilot  models  and  their 
limitations,  and  which  aims  at  overcoming  the  above  problems.  In  this  paper, 
we  treat  a typical  single* loop  manual  control  system  keeping  in  mind  the 
applici’^ion  of  this  method  to  determining  the  $hort*period  pitch  maneuver 
response  requirements  for  aircraft  design. 


FORMUUTION  OF  AN  IMPROVED  METHOD 


Evaluation  Process  of  Manual  Control  System  by  Human  Pilot 

In  this  paper,  we  treat  a typical  single*loop  manual  control  system  shown 
in  Fig.l.  Evaluation  by  a human  pilot  is  considered  as  follows:  when  he  is 
assigned  a control  mission,  his  evaluation  is  due  to  the  amount  of  his  work* 
load  and  the  extent  of  fulfilment  of  the  mission.  To  make  the  above  notion 
clear,  let's  define  the  following  terms: 

(1)  Control  Mission  This  is  the  objective  of  manual  control  set  up  by  external 
factors  of  the  h\iman  pilot.  To  be  concrete,  the  external  factors  are  the 
features  of  the  forcing* function  and  the  controlled  element,  etc..  He  assume 
that  the  mission  is  represented  by  the  gain*crossover  frequency  wc»  ^ich  we 
hereafter  treat  as  the  critical  control  frequency.  If  the  mission  is  a severe 
one,  the  system  should  be  tightly  closed;  then  the  larger  uc  becomes  appro* 
priate. 

(2)  Pilot  Workload  This  may  be  divided  broadly  into  mental  tforkload  and 
physical  workload.  The  mental  workload  corresponds  to  the  human  compensatory 
characteristics,  vihich  means  the  pilot's  self*adjustment  of  his  control 
dynamics  according  to  the  controlled  element  dynamics  in  order  to  accomplish 
the  control  mission.  The  mental  workload  imposed  by  pilot  compensation  can 

be  measxxred  by  using  an  identification  technique  of  human  describing  functions. 
On  the  other  hand,  the  physical  workload  corresponds  to  the  amount  of  physical 
work  done  by  the  pilot.  Measures  of  the  physical  workload  can  be  the 
magnitiale  of  control  column  deflection  c,  or  physiological  responses.  As 
modem  aircraft  are  equipped  with  power*boosted  control,  it  is  possible  to 
adjust  the  control  column  gain  at  the  designer's  option.  Under  **his  trend, 
we  had  better  distinguish  the  problem  of  designing  the  control  c gain 
from  man*machine  closed* loop  analysis.  Hence,  we  hereafter  cho^  -^e  mental 
workload,  or  in  another  word,  pilot  compensation,  as  the  index  oi  pilot 
workload. 

(3)  Control  Performanca  This  is  expressed  by  the  variance  of  the  error.  In 
general,  manual  control  systems  sometimes  have  insufficient  stability  among 
various  representative  closed* loop  characteristics.  For  such  cases  control 
performance  mainly  determined  by  the  closed* loop  resonance. 

(4)  Pilot  Rating  This  is  a rated  mark  put  to  a given  system  by  the  h\aan  pilot. 
He  subjectively  evaluates  the  system  putting* his  workload  and  the  control 
performance  together. 

(5)  Pilot  Compensation  This  is  the  most  influential  factor  upon  the  mental 
workload  and  the  control  performance.  The  himan  pilot  compensates  the  con* 
trolled  element  so  that  the  total  closed* loop  response  shows  satisfactory 
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characteristics. 

Analysis  of  Manual  Control  System 

In  order  to  obtain  the  closed- loop  characteristics,  it  is  convenient  to 
employ  the  amplitude-phase  plots  of  the  open-loop  transfer  function  YpYcCs) 
in  Fig.K  As  typical  examples  of  YpY^  plots.  Fig, 2 is  quoted  from  Ref, 1;  in 
the  figure  we  arranged  the  plots  so  that  the  preselected  bandwidth  (BW)  becomes 

It  can  be  seen  that  in  most  cases  the  plots  are  approximated  by  an  essen- 
tially straight  lines  near  in  amplitude-phase  plane,  and  the  slopes  of  the 
plots  are  relatively  shallow  so  that  the  closed- loop  resonance  is  directly 
estimated  by  the  gain  margin  Ol,  rather  than  the  phase  margin  #M.  For  such 
a case,  GM  can  be  approximated  by  using  the  slope  of  the  plots  and  #1  as: 

GM  = W|YpYc|/d^YpYc)^^^**M  (dBJ . (1) 

where  is  defined  as  follows: 

•H  = iYc(juc)  ♦ ^Yp(jwc)  ♦ « [rad].  (2) 

It  is  worth  noting  here  that  the  above  GM  and  #M  can  be  defined  even  thou^ 
the  controlled  element  has  one  or  two  unstable  poles.  When  the  controlled 
element  has  unstable  poles,  there  exists  a permitted  range  of  gain  variability 
which  can  make  the  system  stable.  In  those  cases,  there  are  two  phase-cross- 
over  frequencies.  If  we  choose  the  larger  frequency,  the  plots  similar  to 
Fig. 2 are  obtained. 

Consider  the  human  compensation  which  is  necessary  for  closed-loop 
stability.  We  rewrite  Eq.(l)  by  using  Eq. (2)  as: 

GM(d^YpYc/d(log«)} 

{dlYcl/ddog...)}  » - {d|Yp|/d(log«)}  (3) 

•<:Yc(j<^)  ♦ ^Yp(j<i>c)  + * 

In  Eq.(3),  pilot  dynamics  is  expressed  by;  ^Yp(j«c),  {d|Ypl/d(\ogui)}  _ and 
{d,:YpY^/d(log<ij) } ^ . Among  these,  the  first  and  the  second  have  difeC? 

relationship  witlf!  Ififiman  compensation.  On  the  other  hand,  it  is  difficult  to 
find  a simple  relationship  between  (d^YpY^^/dClogia) } and  human  compensa- 
tion, for  human  pilot  dynamics  contains  the  react ioHit$me  delay  which 
appears  only  in  phase  characteristics.  For  simplicity  of  the  analysis, 
{d*:YpYc/d(logu)) } is  tentatively  held  constant.  Referring  to  Eq.  (3),  the 
actual  fluctuati8n**8f  {dz.YpYc/d(logw) } can  be  considered  to  be  the  error 
of  the  assumed  GM. 

Now,  we  estimate  the  degree  of  compensation  which  the  pilot  can  produce 
by  employing  htmian  pilot  models  as  follows^* 


Yp(s)  = Kpe‘'®(  1 ♦ \s  ) . 

(4) 

Ypls)  » Kpe'^^  1 ♦ TlS  ♦ Tl’s2  ) . 

(5) 

V / X L-  -TS  1 

Yp  - KpC  j ^ 

(6) 
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where  s denotes  the  Laplace  variable,  and  the  husan  reaction  tiae  delay, 
denoted  by  t,  contains  the  neuro-mscular  lag  tiae  constant  and  is  fixed 
here  as: 

X « 0.3  [sec]  (7) 

Then,  the  relations  between  {d|Yp|/d(log(i>)>  and  zYp(jwc)  obtained  as 
follows:  forEq.(4), 

{d|Yp|/d(logw)>^^^  * 10(  1 . cos2#  ) [dB/decade];  (8) 
for  Eq.(S), 

{dlYnl/d(log«)}  * 20  ♦ 10/  1 ♦ 4atan^4(  1 ♦ cos24  ).(9) 

[dB/decade] 

where  and  for  Eq.(6), 

{d|Ypj/d(logw)}^^^  * -i0(  1 - cos2#  ) [dB/decade].  (10) 

In  the  above  equations,  4 denotes  the  aaount  of  huaan  phase  coapensation  at 

as : 


♦ * i^Yp(jwc) 


(11) 


There  are  sufficient  aaount  of  htaan  describing  functions  for  confiraing 
the  huaan  coapensatory  dynamics,  which  have  been  obtained  through  various 
experiaents  so  far.  We  can  sample  the  hia^n  coapensatory  dynamics  in  the 
fora  of  {d|Yp|/d(logw}}  and  ^Yp(jiUc).  Comparison  of  these  data  with  Eqs. 
(8),  (9)  and  (10)  are  shi$wi$^in  Figs. 3 and  4,  which  indicate  distinct  features 
of  huaan  coapensatory  dynamics  and  their  limitations.  It  should  be  noted  that 
for  simplicity,  we  eaploy  an  approximation:  for  the  cases  of  second* 

order  controlled  element;  that  is  due  to  the  fact  that  the  most  effective 
factor  in  determining  the  crossover  frequency  for  those  cases  seems  to  be  the 
natural  frequency  of  the  controlled  element.  In  suamary,  for  cases  where 
human  phase  lead  4 is  negative,  we  can  approximate  Yn  with  Eq.(6);  for  cases 
where  4 is  positive  and  within  «/2[rad],  we  can  use  lq.(4);  for  the  cases 
where  4 is  greater  than  tr/2[rad]  and  within  v[rad],  we  can  use  Eq.(5).  Using 
these  huaan  pilot  models  and  their  limitations,  we  now  introduce  an  analytical 
aethod  for  estimating  pilot  ratings. 

Derivation  of  Evaluation  Chart 

Let's  aake  an  ^valuation  chart  which  shows  the  distinct  relationship 
between  the  controlled  element  characteristics  at  wc  and  the  closed* loop 
perfonsance  determined  by  human  coapensation. 

Firstly,  we  derive  conditions  of  the  controlled  element  in  which  closed* 
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loop  stability  holds  for  a given  huaan  pilot  BK>del. 

(i)  stAbiXity  conditions  of  the  closed-loop  system  without  any  pilot 
compensation 

The  closed- loop  system  is  stable  when 


and 


GM  > 0 [dB] 

(12) 

?M  > 0 [rad] . 

(13) 

Substituting  the  above  conditions  into  Eqs.(l)  and  we  obtain: 


[liMcL  1 > 0 

d(logw) 

[dB/rad] 

(14) 

and 

^Yc(jwc)  - twe  ^ 

[rad]. 

(IS) 

In  general , 

{d<,YpYc/d(logu.)}^^^  < 0 

[rad/decade] , 

(16) 

thus , from  Eq.  U4) : 


(d|Ycl/d(logui)}^^^^  < -{d|Ypj/d(logu.)}^^  [dB/decade].  (17) 

As  the  pilot  employs  no  compensation: 

IdlYpl/ddogu))  ^ • 0 [dB/decade]  (18) 

and  u*«*»c 

♦ = 0 [rad].  (19) 

Substituting  the  above  equations  into  Eqs. (15)  and  (17),  we  finally  obtain 
the  following  stability  conditions: 


and 


{d|Ycl/d(logu))}^^^^  < 0 [dB/decade] 

-Yc(jiiic)  • f<*>c  * [rad] . 


(20) 

(21) 


The  human  pilot  can  stabilize  the  controlled  elements  in  the  region  satisfying 
Eqs. (20)  and  (21)  without  any  compensation:  the  region  is  shown  in  the  chart 

of  Fi^.S,  where  the  abscissa  is  *iYc(ju»c) -twc»  and  the  ordinate  is 
{di Ycl /d(logu))}  _ Hereafter,  we  explain  the  following  regions  by  using 
the  same  ch'rt.^  *^^ 

(ii)  stability  conditions  with  first-order  pilot  lead 

Stability  conditions  are  the  same  as  Eqs. (15)  and  (17).  Employing  Eq.(8),  we 
can  rearrange  Eq.(17)  a-: 

{d|Ycl/d(logw)}^^^^  < -10(  1 - cos2^  ) (22) 

The  human  pilot  can  stabilize  the  controlled  elements  in  the  region  satisfying 
the  above  conditions  with  first-order  lead.  Noting  that  Eq.(8)  holds  when 


247 


OHiGiiNAL  PAGE  IS 

OF  POOR  QUALITY 


0^i>4«/2[radl , the  region  in  .ne  chart  is  obtained  by  moving  the  region 
satisfying  conditions  (i)  in  parallel  along: 

{dlYcl/d(log<«))^^  . -10(  1 - cos2f  ) ( 0 < ♦ < w/2[rad]  ).(23) 

(ill)  stability  conditions  with  sectmd^rder  pilot  lead 
^bstituting  Eq.(9)  into  Eq.  (17) , we  obtain  the  conditions: 

{d|Ycl/d(logu)}^^^  < -20  - 10/  I ♦ 4atan^4(  1 ♦ cos2*  ) (24) 

and  Eq.(I5).  The  widest  region  is  obtained  when  a«0  in  Eq. (24)  as: 

{dlYc|/d(logu)l^^^  < -10(  3 ♦ C0S24  ).  (25) 

Noting  that  Eq*(9)  holds  when  w/2<4<ir[rad] , the  region  in  the  chart  is 
obtained  by  aoving  the  region  satisfying  conditions  (i)  In  parallel  along: 

(d|Yc|/d(log«)}^^  « -10(  3 ♦ COS24  ) ( v/2  < ♦ < »[rad]  ).(26) 

(iv)  stability  conditions  with  first-border  pilot  lag 

Siailarly,  the  region  in  the  chart  is  obtained  by  Moving  the  region  satisfying 
conditions  (i)  - - 'parallel  along: 

(dlYc|/d(log<u)}^^  - 10(  1 - COS24  ) ( -v/2  < ♦ < 0[radj  ).(27) 

(v)  stability  conditions  with  first-order  pilot  lead  and  lag 

This  region  is  obtained  by  Moving  the  region  satisfying  conditions  (ii)  in 
parallel  along  Eq.(27),  just  as  the  region  satisfying  conditions  (iv)  is 
obtained  from  the  region  satisfying  condiitons  (i). 

Secondly,  we  derive  conditions  of  the  controlled  eleaent  in  which  GM  is 
kept  greater  than  a certain  value*  As  an  example,  the  following  condition 
is  examined: 


GM  > 1.5  [dB].  (28) 

It  seems  proper  as  condition  of  the  phase  slope  to  choose: 

{d^YpYc/d(log«)}^^^  * -4  [rad/decade].  (29) 

Using  Eqs.(28)  and  (29),  the  conditions  are: 

(30) 

and  Eq. (15). 

(vi)  GM  > 1.5  [dBJ  without  any  pilot  compensation 

The  conditions  are  directly  obtained  from  Eqs.(30)  and  (IS)  as: 

{d|Ycl/d(logu)}  < — v-Ti — : (51) 

and 
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(32) 


In  the  same  way»  the  following  conditions  are  obtained: 
(vii)  GM  > i.5  [dB]  with  first^rder  pilot  lead 
(viii)  GM  > i.5  [dB]  with  first-order  pilot  lag 
(ix)  GM  > 1.5  [dB]  with  first-order  pilot  lead  and  lag 


COMPARISON  OF  THE  EVALUATION  METHOD  WITH  PREVIOUS  DATA 


The  data  (d|Ycl/d(loguj)}  _ , zYc(jwc)  and  corresponding  pilot  rating 

are  obtained  from  previous  experiments.  Firstly,  comparison  with  the  data 
from  Ref.l  is  shovm  in  Fig. 6,  where  we  tentatively  set  as  equal  to  BW. 

Fig. 6 indicates:  (1)  If  the  human  pilot  can  keep  GM>1.5[dB]  without  any  com- 
pensation, pilot  rating  is  acquired  as  PR^S.S;  (2)  If  the  human  pilot  can  keep 
GM>1.5[dB)  with  first-order  compensation,  pilot  rating  is  acquired  as  3.5<PR<, 
6,5;  (3)  Otherwise,  6,5<PR. 

Now,  we  examine  the  method  in  the  extreme  cases  near  human  contTO liability 
limits.  The  controllability  limits  are  reported  in  various  papers^*^^. 
iYc(jwc)and{d|Yc|/d(log<*)))  _ of  the  second-order  controlled  elements  in  the 
region  of  human  control latSrf^ty  limits  are  sho%m  in  Fig. 7,  where  we  set  wc 
equal  to  /Tu)n*  Note  that  for  these  cases  the  human  reaction  time  delay  is 
mc^ified  as  Ts0.2[sec].  It  can  be  seen  from  Fig. 7 that  near  the  controlla- 
bility limits  the  hiiman  pilot  employs  second-order  lead.  Finally,  it  is  noted 
that  the  controllability  limits  of  the  first-order  divergent  elements  are  also 
explained  by  this  chart.  It  should  be  added  here  that  experimental  results  of 
these  cases  are  somewhat  greater  than  the  analytical  results;  this  implies  that 
controllability  limits  are  not  determined  by  GM*0  but  that  GM  should  be  greater 
than  a some  positive  value. 


DISCUSSION  ON  ADVANTAGES  AND  DISADVANTAGES  OF  THE  EVALUATION  METHOD 


The  precedent  comparisons  indicate  that  the  proposed  evaluation  method 
can  generally  predict  the  ratings  by  human  pilots.  Advantages  of  this 
evaluation  method  compared  with  existing  ones  are  as  follows:  (1)  Easiness  of 
evaluation;  (2)  Applicability  to  any  controlled  element  irrespective  of  its 
stability;  (3)  Predictability  of  controllability  limits  of  manual  control;  (4) 
Possibility  of  estimating  human  pilot  dynamics  simultaneously  with  control 
difficulty  or  pilot  control  efforts. 

Items  to  be  discussed  concerning  this  evaluation  method  are  as  follows: 

(1)  The  method  gives  no  definite  wc*  general,  wc  depends  on  the  control 
mission.  It  seems  proper  that  should  be  classified  according  to  the  flight 
phases  just  as  Ref. 2.  Nevertheless,  the  proposed  method  has  another  advantage: 
the  results  of  the  method  is  insensitive  to  the  change  of  wc-  Referring  to 
Bode*s  theorem,  4Yc(ja>c)  has  correlation  with  {dlYc|/d(logw)}  ^ when  the 
controlled  element  is  of  minimum  phase  system;  thus  the  resulVs^fiove  almost  in 
parallel  along  to  the  borders  and  then  slightly  laterally  due  to  the 
difference  of  wc;  (2)  In  the  cases  to  which  the  assumptions  of  this  method 
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cannot  be  applied,  the  results  may  have  large  error.  Possible  origins  of  such 
error  may  be:  assumptions  that  closed-loop  stability  is  most  effective  in  the 
determination  of  pilot  ratings,  that  t and  {d^YpYc/d(logw)>  are  set  to  be 
constants.  ^ 


CONCUJSION 


By  fully  making  use  of  human  pilot  models  and  their  limitations,  an 
analytical  evaluation  method  of  predicting  pilot  ratings  is  proposed  and 
examined.  The  evaluation  chart  can  generally  explain  the  pilot  ratings  and 
human  controllability  limits.  The  method  can  be  widely  applied  to  problems 
of  single-loop  manual  control. 
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OF  POOR  QUALITY 


Figure  1.  Single-Loop  Manual  Control  Figure  2.  Example  of  Amplitude- Phase 
System  Plots  from  Ref.l 


Figure  3,  Comparison  between  Human  Pilot  Models  and  Experimental 
Results 
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Figure  4.  Comparison  between  Human  Pilot  Models  and  Experimental  Results 
when  Yc  “ ^ ^Cw^s  + uijx^  ) 


Figure  S.  Chart  for  Evaluating  Manual  Control  System 
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Figure  6.  Proposed  Evaluation  Method  Plotted  Against  Experimental 
Results  from  Ref.l 


Figure  7.  Proposed  Evaluation  Method  Plotted  Against  Experimental 

Controllability  Limits  when  Yq  » ♦ ujn^  ) 
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ABSTRACT 


This  report  presents  a study  of  approach  and  landing  longitudinal  frying 
qualities,  based  on  data  generated  by  Calspan  using  a variable  stability  NT-33 
aircraft  combined  with  significant  control  system  dynamics.  An  optimum  pilot 
lead  time  for  pitch  tracking,  flight  7'*th  angle  tracking,  and  combined  pitch  and 
flight  path  angle  tracking  tasks  is  determined  from  a closed^loop  simulation 
using  integral  squared  error  (ir»i^'  a performance  measure.  Pilot  gain 
and  lead  time  were  varied  In  the  'd-loop  simulation  of  the  pilot  and 
aircraft  to  obtain  the  best  cc  fer  different  control  system 

configurations.  The  results  lead  to  the  selection  of  an  optimum  lead 
time  using  ISE  as  a performance  criterion.  Using  this  value  of  optimum 
lead  time,  a correlation  Is  then  found  between  vilot  rating  and  pevformance 
with  chanqes  in  the  control  system  and  ir  the  aircraft  dynamics.  It  is 
also  shown  that  pilot  ratir^  is  closely  related  to  pilot  workload  which. 

In  turn,  is  related  to  the  ^.nount  of  lead  which  the  pilot  must  generate 
to  obtain  satisfactory  response.  The  results  also  Indicate  that  the  pilct  may 
use  pitch  angle  tracking  for  the  approach  task  and  then  adds  flight  path  angle 
tracking  fr^r  the  flare  and  touchdown. 


'•*4 


INTRODUCTION 

Aircraft  handling  qualities  and  pilot  behavior  during  the  glide  slope, 
flare,  and  landing  phases  of  the  flight  renine  are  considered  In  this  paper. 

The  results  are  extracted  frtM  the  study  perfonaed  by  Pasha  , and  complete 
details  may  be  obtained  fron  that  report.  This  study  Is  based  on  data 
generated  by  Calspan^  which  Investigated  the  effects  of  control  system  dyv^amlcs 
on  approach  and  landing  longitudinal  flying  qualities  by  using  an  NT-33A 
variable  stability  aircraft.  A large  nuiaber  of  aircraft/control  system 
configurations  were  flown  by  Cat span  and  pilot  comments  and  ratings  are 
contained  It  '^ef.  ?.  Anderson  has  postulated^  that  pilot  rating  Is  closely 
related  to  p*iot  workload  and  that  this  1$  determined  by  the  amount  of  lead 
wnich  the  pilot  must  generate  to  maintain  reafionable  response.  Using  these 
postulates,  the  direction  of  this  study  was  to  Investigate:  (1)  the  relationship 

between  pilot  workload  and  aircraft  control  system  dynamics,  (2)  the  output 
variables  of  primary  Interest  to  the  pilot.  This  was  accomplished  by 
simulating  the  combined  pilot  model,  aircraft  dynamics,  and  control  system 
as  a closed-loop  pitch  angle  and  flight  path  angle  tracking  task  with  the 
objective  of  finding  a correlation  between  the  closed-loop  performance 
and  the  pilot  ratings.  The  closed-loop  pitch  response  to  a step  pitch 
command  was  studied.  Pilot  ,a1n  and  pl^ot  generated  lead  were  varied  In 
order  to  obtain  the  "best"  performance  for  different  control  system  configure* 
tions.  Tills  was  repeated  for  closed-loop  flight  path  angle  response  (both 
with  and  without  pitch  feedback).  The  closed-loop  pitch  and  flight  path 
angle  responses  were  studied  for  different  alr^.'aft  dynamics.  Again  the 
pilot  gain  and  pilot  generated  lead  were  varied  to  obtain  the  best  response. 

The  Integral  of  error  squared  (ISE)  was  used  throughout  as  a mea.^ure  of 
performanc::. 

Aircraft  Equations 

■ — ^ g 

The  linearized  longitudinal  aircraft  equations  are  well  known  * and 
are  not  repeated  here.  The  coefficients  used  In  these  equations  for  the 
different  aircraft  dynamics  are  Included  in  the  original  reports  . 

The  aircraft  forward  speed  was  considered  constant.  The  phugofd  mode  Is 
easily  controlled  by  the  pilot  and,  since  the  time  frame  In  which  the  landing 
task  Is  completed  Is  relatively  small,  only  the  short  period  aircraft  dynamics 
^ere  used  In  this  study. 

The  wandlng  Task  As  Seen  By  A Pilot 

During  the  approach-to-landing  phase  of  flight  the  aircraft  Is  Initially 
on  the  glide  slope  and  the  pilot  must  decide  on  the  minimum  height  to  flare. 

At  this  time  the  pitch  attitude  0 and  the  flight  path  angle  y appear  to  be  of 
considerable  Importance  to  the  pilot.  The  minimum  height  to  flare  Is  an 
Imagine  ' window  on  the  glide  slope  which  the  pilot  selects  relative  to  the 
runway  v.ieshold  or  touchdown  point.  The  selection  of  the  Imaginary  window 
In  space  depends  on  the  aircraft  forward  speed,  aircraft  dynamic  characteris- 
tics, and  the  experience  of  the  pilot  In  handling  the  aircraft.  During  the 
flare  maneuver  the  sink  rate  II  (vertical  velocity)  and  the  slant  renge  rate 
ft  (the  rate  at  which  the  runway  threshold  or  touchdown  point  appears  to  be 
approaching)  art  visual  motion  cues  for  the  pilot.  The  pilot  pitches  up  an/ 
establishes  a desired  f\  and/or  ft  until  touch  down,  where  h,  fi  and  R go  to  zero. 
All  three  output  variables,  h,  li,  and  R,  are  n;a thematically  related  to  the 
flight  path  angle  y as  shown  below. 
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For  small  angles  the  flight  path  angle  y Is  given  by 

Y » e - a (1) 

The  sink  rate  h Is  given  by; 

h » ^oiny=  U^y  (2) 

The  slant  range  rate  R is  the  v :tor  sun  of  U and  h.  Since  is  assuned 

constant « R is  directly  proportional  to  h or  y.  Therefore,  all  the  motion 
cues  are  direct  functions  flight  path  angle  y.  Hence  the  dynamic  behavior 
of  9 and  y for  elevator  comands  (6  ) is  representative  of  the  overall  landing 

task. 

Pilot  Describing  Function 

5 

The  basic  McRuer  pilot  model  used  in  this  study  is  represented  by 

%(s)  * 

By  adjusting  and  t the  pilot  cxhieves  the  level  of  closed*loop  systen 

performance  which  he  considers  desirable  or  necessary.  This  is  accomplished 
at  the  expense  of  pilot  activity  and  workload.  One  way  to  optimize  performance 
is  to  adjust  the  model  parameters  to  minimize  the  integral  of  squared  error 
(ISE).  The  **1ead  only"  form  of  pilot  model  was  used  because  pilot  lag  may  be 
neglected  when  higher-order  control  syrtem  lags  are  present.  A value  of 
T * 0.3  was  used. 

Pilot  Rating  Concepts 

Pilot  Ratings  are  based  on  nurierical  rating  scales,  such  as  the  Cooper- 
Harper  scale,  which  represent  an  attempt  to  relate  pilot  comments  about  the 
ease  of  difficulty  with  which  airplanes  can  be  controlled  in  certain  flight 
situations.  The  ratings  are  ordinal  scales  subjectively  applied  and  hence 
are  difficult  to  Quantify.  Predictions  of  pilot  ratings  require  mathematical 
relations  between  the  numerical  rating  scale  and  "how  hard  a pilot  must  work” 
to  achieve  "desired  closed-loop  performance".  Developing  mathematical  relation 
appears  to  be  extremely  complex,  though  certain  trends  have  been  identified. 

For  example  a pilot  objects  If  he  has  to  generate  "leads"  (T^)  of  more  than 

0.5  to  1.0  seconds  [6].  The  factors  which  may  be  taken  Into  account 
by  a skilled  test  pilot  in  providing  an  opinion  or  rating  are  Measure 
of  task  performance,  Pilot  workload,  and  System  sensit^'^ity.  These  factors 
are  obviously  affected  by  the  particular  aircraft  dynamics,  including  any 
additional  control  systems.  As  a mathematical  function,  pilot  ratings  (PR) 
can  be  expressed  as : 

PR  * f( Performance,  workload,  sensitivity,,..)  (4) 

Pilot  Workload 

The  pilot  workload  can  be  divided  Into  pilot  activity  and  pilot  equal- 
ization. Pilot  activity  is  dependent  on  the  pilot  gain  Kp  and  is  an  important 

component  of  Pilot  Rat*  « the  presence  of  gust  disturbances  and  remnant. 
Pilot  gain  is  also  dete  -led  by  the  mechanical  arrangement  of  the  controls 
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Dlaced  between  the  pilot  and  the  elevator.  The  data  generated  by  Cal  span 
allowed  the  pilot  to  select  the  gearing  r|tio  for  each  flight  evaluation 
The  pilot  equalization  can  be  represented^  by  the  pilot's  “lead"  time 
constant  and  is  used  in  this  study  to  represent  workload. 

Analog  Computer  Simulation 

An  analog  computer  simulation  was  used  to  find  an  optimum  pilot  lead 
time  which  yields  the  best  system  performance  for  the  a ire raft- control 
system.  The  objective  was  two  fold:  (1)  To  see  if  a correlation  exists 

between  performance  and  Pilot  Rating,  (2)  To  see  if  the  pilot  could  improve 
the  system  performance  by  choosing  different  forms  of  pitch  angle  and  flight 
oath  angle  feedback.  The  pilot  gain  and  lead,  T^  were  adjusted  to 

minimize  ISE  (the  performance  criterion)  when  the  pilot  performed  a 
tracking  task  for  a step  comand.  The  effects  of  adding  control  systems 
on  the  performance  were  first  studied  for  an  aircraft  characterized  by 
a short  period  natural  frequency  and  damping  ratio  of  1.02  rad/sec 
and  0.74  respectively,  here  after  referred  to  as  A/C  1.  See  Raf  2 for  the 
stability  and  control  derivatives  of  this  aircraft.  The  tracking  task  was 
analyzed  in  three  phases:  1)  Inner-loop  pitch  attitude  (6)  tracking  for  a 

step  pitch  command;  2)  outer-loop  flight  path  angle  (y)  tracking  for  a 
step  Y -command;  and  3)  combined  pitch  and  flight  path  angle  tracking  (inner 
and  outer  loop)  to  minimize  the  error  in  the  flight  path  angle  for  a step 
\-comnand.  These  three  phases  were  repeated  for  four  additional  aircraft 
using  the  baseline  control  system  (control  system  * 1)  to  observe  the 
performance  variations  between  the  five  aircraft  configurations.  The 
objective  of  the  analog  simulation  study  was  to  find  optimum  pilot  parameters 
\ which  would  minimize  the  ISE  for  a particular  tracking  task. 

Pitch  Attitude  Tracking  Ta^k 

The  block  diagram  used  for  the  T^isylation  is  shown  in  Fig.  1.  The 
aircraft  with  no  control  system  dynamics  was  ar?lyzed  first.  The  control 
systems  which  were  flown^  with  this  aircraft  were  then  cumulated. 


Figure  1.  Block  Diagram  of  Pitch  fracking  Task 


The  pilot  lead  time  T.  was  varied  from  C to  1.25  sec  in  steps  of  0.25  sec. 
For  each  value  of  T^,^the  pi^ot  gain  was  varied  and  the  value  of  ISE  was 

recorded  for  a step  pitch  command  (6^).  Reprc^c.  ative  graphs  showing  the 

data  thus  generated  are  shown  In  Figs  2 thru  5.  While  pilot  lead  tiroes 
greater  t‘ a'l  0.5  or  0.75  sec  produce  a slight  improvemert  in  the  system 
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performance*  they  do  so  at  the  expense  of  greater  pilot  workload.  Also, 
the  curves  for  1.0  and  1.25  sec.  lead  time  show  much  larger  variations  In 
the  val'je  of  ISE  about  the  mlnlnuRi,  thus  Indicating  higher  systeis  sensitivity 
to  pilot  gain  variations.  Therefore,  a value  of  0.5  or  0.75  sec.  pilot 
lead  seems  to  be  the  optimum  choice.  Fig.  4 shows  the  performance  curve 
with  control  system  dynamics  2/(s*2).  Since  this  control  system  Introduces 
a significant  amount  of  lag  near  the  short  period  natural  frequency  of  the 
aircraft  (1  rad/sec),  the  aircraft  dynamics  response  is  very  sensitive  to 
gain  change.  In  other  words,  for  good  performance  the  pilot  must  hold  the 
gain  very  steady  to  maintain  good  performance.  This  amounts  to  an  additional 
workload  in  terms  of  pilot  concentration  and  hence  a degraded  pilot  opinion 
of  the  task.  The  value  of  minimum  ISE  and  the  corresponding  pilot  ratings 
are  plotted  in  Figs.  6 and  7 for  a 0.5  and  0.75  sec.  pilot  lead,  respectively. 
The  plots  show  an  Increase  in  pilot  rating  as  the  performance  degrades  for 
control  systems  which  introduce  lag.  The  reverse  trend  for  control  systems 
which  introduce  lead  is  a puzzle  which  could  not  he  explained. 

Flight  Path  Angle  Tracking  Task 

During  the  flare  maneuver,  the  sink  rate  information  is  one  of  the  visual 
cues  the  pilot  uses  In  performing  the  landing  task.  Since  flight  path  angle 
^ is  directly  related  to  the  sink  rate.  It  is  logical  to  analyze  the  pilot 
in  the  >-1oop.  This  was  done  by  first  assuming  no  pitch  angle  feedback. 

The  block  diagram  used  for  this  simulation  is  shown  in  Fig.  8. 


Figure  8.  Block  Diagram  of  > Tracking  Task 

The  ISE  (fe‘)  was  measured  for  a step  y-command.  The  pilot  parameters  K and 

were  varied  and  the  procedure  used  for  the  analysis  of  Ditch  loop  was 

repeated,  vis-a-vis,  measuring  the  value  of  ISE  until  a minimum  Is  reached, 
as  K and  were  varied.  Similar  performance  was  obtained  as  for  the 

pitch  angle  control  and  the  results  are  contained  In  Ref.  1.  The  optimum 
pilot  lead  was  0.75.  However,  the  minimum  values  of  ISE  achieved  were  much 
greater  than  for  pitch  angle  tracking.  Therefore  wr.s  concluded  that  the 
pilot  is  more  inclined  to  use  pitch  angle  tracking  while  on  the  glide  slope. 
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Combined  Pitch  and  Flight  Path  Angle  Tracking 


The  next  step  was  to  study  the  effect  of  feeding  both  pitch  and  flight 
path  angle  as  a multi-output  system  for  a single  input  step  y-cowaand. 
Figure  9 shows  a block  diagram  of  the  system  used  for  simulation. 


Figure  Both  e and  y Tracking  Task  For  A Step  y-Command 

The  analysis  was  restricted  to  aircraft  1 and  the  lag  control  systems  flown 
with  aricraft  1.  The  Mead  only*  form  of  pilot  dynamics  was  used  for  the 
pilot  in  the  pitch  loop.  Two  values  of  0.5  and  0.75  seconds,  were  used, 

and  the  corresponding  gains  K which  minimized  the  ISE  in  the  pitch  tracking 

Pe 

task  were  obtained.  Since  the  closed-loop  pitch  transfer  function  forms 
a type  zero  system,  using  only  pilot  gain  K in  the  outer  loop  would 

7 

result  in  a steady-state  error  for  a step  y-command  Input  . Therefoi^  an, 

integral  plus  proportional  control  system  was  used,  as  shown  in  Figure  9, 
to  represent  the  pilot  in  the  outer  loop.  Pilot  reaction  time  delay  was 
not  Included  in  the  outer  loop.  The  transfer  function  used  for  integral 
and  proportional  control  has  the  form; 


G(s)  = ■>  + I (5) 


Determining  the  appropriate  value  of  'a*  to  be  used  for  the  task  was  the  next 

step.  Therefore,  K was  varied  and  the  ISE  /e^  was  measured  for  a step 
Py  y 

Y-command,  while  the  value  of  "a”  was  varied  from  0.1  to  0.4  in  steps  of  0.05. 
This  proceedure  was  used  with  both  a T^  of  0.5  and  0.75  seconds  for  pilot 

lead  in  the  pitch  loop.  The  data  thus  generated  showed  that  a value  a » 0.2" 
minimized  the  ISE,  and  this  value  was  used  for  subsequent  analysis. 

The  lag  control  systems  flown  with  aircraft  1 were  simulated  to  study 
the  effect  of  performance  degradation  on  pilot  rating.  The  outer  loop 

pilot  gain  K was  varied  and  the  ISE  /e^  was  recorded  for  a step  y-cowwand. 

Py  y 
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Figure  10  shonrs  a olot  of  ISE  fe^  versus  the  K for  various  lag  control 

T 

systems.  The  pilot  rating  (PR)  is  also  shown.  The  effect  of  performance 
degradation  on  pilot  rating  can  be  clearly  seen  from  these  plots.  Figure 
n shows  the  plot  of  minimum  ISE  /e^  versus  the  PR  for  aircraft  1 without  the 

control  system  and  with  the  lag  control  systems.  These  figures  indicate 
a direct  relationship  between  PR  and  performance  for  a fixed  pilot  workload. 

In  this  control  system  an  outer  loop  gain  and  integral  plus  proportional 
control  is  required  from  the  pilot.  The  task  of  integrating  an  error 
essentially  means  remembering  the  past  errors  and  thus  represents  an  increase 
in  the  pilot  workload.  Whether  the  pilot  likes  this  kind  of  additional 
load  or  if  the  additional  workload  is  worth  the  improvement  in  the  performance 
needs  to  be  determined.  Also,  for  a multi-output  tracking  task,  how  the  pilot 
would  time  share  Ms  control  of  the  two  outputs  6 and  y needs  to  be  investigated. 
It  may  be  possible  that  during  the  glide  slope  the  pilot  is  flying  the  aircraft 
by  tracking  only  the  pitch  angle  6 up  to  a certain  altitude  where  the  sink 
rate  h becomes  important.  This  altitude  may  be  about  100  feet,  where  the 
pilot  may  begin  tracking  both  pitch  angle  and  flight  path  angle  until  the 
flare  maneuver.  During  flare,  especially  the  last  50  feet,  the  pilot  may 
switch  over  to  tracking  only  the  altitude,  assuming  that  he  has  done  his 
best  to  stabilize  the  9-loop.  A plot  of  ISE  versus  is  shown  in  Figure  12 

f a pitch  loop  of  0.5  and  0.75  seconds  for  the  three  tracking  tasks 

u ing  aircraft  1 without  the  control  systems. 

The  above  hypothesis,  i.e.,  during  approach  the  pilot  is  essentially 
tracking  the  pitch  attitude  and  during  flate  and  landing  phase  the  pilot 
1s  tracking  the  flight  path  angle  while  holding  a fixed  optimum  pitch  loop 
rarforwance  may  be  verified  by  the  following  proceedure.  In  a large 
umber  of  flight  configurations  flown,  the  pilot  evaluated  the  approach  task 
and  the  overall  landing  task  separately  and  provided  two  different  ratings. 

An  optimum  pilot  workload  and  performance  evaluation  can  be  performed  on  an 
analog  computer.  The  proceedure  described  in  this  paper  and  those  flight 
configurations  for  which  both  ratings  were  provided  may  be  used;  first  as 
a pitch  tracking  task,  and  then  as  a y-loop  tracking  ' isk  with  the  pitch 
loop  optimized  as  per  the  first  analysis.  Tnc  results  thus  obtained  can  be 
correlated  with  the  corresponding  approach  and  overall  pilot  ratings  to 
validate  the  hypotheses.  This  analysis  was  not  carried  out  due  to  lack  of 
time.  The  data  generated  In  this  study  indicates  a possible  correlation 
with  pilot  ratings  but  is  insufficient  to  draw  positive  conclusions  about  tnis 
hypothesis. 

Pitch  Attitude  Tracking  for  Different  Aircraft 

The  previous  analysis  was  extended  to  other  aircraft.  Similar  results 
were  obtained  for  all  aircraft  as  shown  In  Fig.  13. 

Summary  of  Results  of  Closed-Loop  Analog  Simulation 

The  following  are  the  results  of  the  study: 

1)  A lead  time  of  0.5  to  0.75  seconds  seems  to  be  the  optimum  pilot  lead 
for  most  of  the  aircraft-cortrol  system  combinations. 

2)  Control  systems  generating  significant  lag  at  the  short  period  natural 
frequency  tend  to  make  the  system  very  sensitive  to  gain  changes. 
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3)  Performance,  measured  In  terns  of  ISE,  has  a direct  correlation 
with  PR  for  aircraft  with  control  systems  which  introduce  lag. 


4)  Closing  both  the  pitch  and  flight  path  angle  loops  for  a y-conmand, 
improves  the  performance  but  at  the  cost  of  increased  pilot  compensation. 
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PILOT  OPINIONS  OF  SAMPLING  EFFECTS 
IN  LATERAL-DIRECTIONAL  CONTROL 


bert  F.  Stengel*  and  George  E.  Miller** 
Flight  Research  Laboratory 
Princeton  University 
Princeton,  N.  J.  03544 


Flight  experiments  with  a microprocessor  control 
system  have  been  conducted  to  determine  the  effects  of  varia- 
tions in  sampling  parameters  on  several  pilots*  opinions  of 
lateral-directional  flying  qualities.?  Princeton's  Variable- 
Response  Research  Aircraft  (VRA) , which  is  equipped  with  a 
microprocessor-based  digital  flight  control  system  (Micro-DFCS) , 
was  the  test  vehicle.  Two  U.S , Navy  pilots  evaluated  the 
effects  of  sampling  rar.e,  quantization,  and  pure  time  delay 
during  tracking,  approach,  and  landing.  Aircraft  carrier 
approach  tasks  were  conducted  using  a Navy  approach  mirror. 
Acquisition  and  tracking  of  fixed  objects  on  the  ground  pro- 
vided additional  information  related  to  the  Navy  mission. 

This  research  is  an  extension  of  the  longitudinal  in- 
vestigation reported  in  Ref.  1.  In  the  present  case,  the 
longitudinal  controls  were  implemented  with  analog  electronics, 
while  the  lateral-directional  pi'ot  inputs  (stick  and  rudder) 
were  fed  to  the  Micro-DFCS,  which  coramandod  the  ailerons  and 
rudder.  Full  details  of  the  systems  and  experimental  procedures 
can  be  found  in  Refs.  1 to  3.  Figure  1 illustrates  the  con- 
ceptual relationship  between  the  evaluation  pilot's  lateral- 
directional  inputs,  the  flight  computer,  and  the  aircraft. 


* Associate  Professor  of  Mechanical  and  Aerospace  Engineerinc . 
**  Member  of  the  ?achnical  Staff, 
t This  work  was  conducted  under  Contract  No.  N00014-78-C-V? 
for  the  Office  of  Naval  Research. 

Presented  at  the  16th  Annual  Conference  on  Manual  Control, 
Cambridge,  Mass. , May,  1980. 
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The  flight  test  results  are  summarized  in  Figs.  2 
to  4.  For  simulated  carrier  landing  approaches,  he  two  naval 
aviators  founu  sampling  rates  of  10  per  sec  or  higher  accept- 
able, with  computational  time  delay  fixed  ac  10  msec,  as 
indicated  by  pilot  opinion  ratings^  of  3.5  or  less  (Fig*  ^) • 
Holding  sampling  rate  at  20  per  sec,  equivalent  time  delays  'yf 
about  100  msec  or  less  were  acceptable,  and  the  degradation  n 
pilot  rating  was  found  to  be  3 “,near  in  the  delay.  (The  equiva- 
lent delay  is  defined  to  be  the  computational  delay  plus  half 
the  S2unpling  interval).  With  sampling  rate  ? \d  pure  delay 
fixed  at  20  per  sec  and  10  msec,  respectively,  control  word 
lengths  of  10  bits  were  found  to  be  acceptable,  while  the 
allowable  value  dropped  to  8 bits  for  tracking  at  altitude 
(Fig.  3) . Figure  4 illustrates  that  somewhat  lower  values  of 
sampling  rate  were  found  acceptable  when  tracking  at  altitude, 
but  the  tolerance  to  equivalent  time  delays  was  greatly  reauced. 

Ihe  present  results  are  applicable  to  the  VRA  with 
unaugmented  dynamics;  the  effects  of  dynamic  variations,  which 
can  be  provided  by  the  VRA*s  variable-stability  system,  remain 
to  be  defined. 

REFERENCES 


1.  Stengel,  R«  F.,  and  Miller,  G.  E.,  •'Flight  Tests  of  a 
Microprocessor  Control  System",  AIAA  Paper  No.  79-1962 
Los  Angeles,  Oct  1979  (to  appear  in  the  AIAA  Journal  of 
Guidance  and  Control) . 

2.  Seat,  J.  C.,  Miller,  G.  E.,  and  Stengel,  R.  F.,  "A  Micro- 
processor System  for  Flight  Con.rol  Research**,  Proceedings 
of  the  1979  National  Aerospace  « Electronics  Conference, 
Dayton,  Miy  1979,  pp.  319-326. 

3.  Stengel,  R.  F.,  "Digital  Flight  Control  Research  Using 
Microprocessor  Technology*',  IRE’S  Transaction*  on  Aerospace 
and  Electronic  Systems,  Vol.  AES-lS, No.3,  May  1979, pp. 397-404. 

4 cooper,  G.  E.,  and  Harper,  R.  P.,  Jr.,  "The  Use  of  Pilot 
Rating  in  the  Evaluation  of  Aircraft  handling  Qualities**, 

NASA  TN  D-  S3,  April  1969- 


Pure  Time  Delay  ■ 10  msec  - Sampling  Kate  ■ 20  per  sec 

o Pilot  C n . Open  Symbol:  Turn/Acouisition 


OF  TOR  QUAUTY 


mm  nowido  loiid 


268 


Figure  2.  Pilot  Opinion  Ratings  for  Field  Carrier  Landing  Practice,  V"C6  KIAS. 
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INTRODUCTION 


There  is  good  evidence  that  the  quality  of  probabilistic  forecasts*  and 
meteorological  forecasts  In  garticular.  Is  lH?proved  by  aggregating  the  opinions 
of  individual  forecasters. 8*9, 10, 12  The  question  of  ho%i  best  to  do  the  aggre- 
gation has  raised  a mmiber  of  Important  Issues.  How  large  should  the  group  be? 
Should  it  be  a nominal  group  or  one  In  which  members  Interact,  and  If  the  lat- 
ter, what  sort  of  Interaction?  By  what  mathematical  rule  should  individual 
jud^nts  be  combined  to  form  the  group  judgment,  or,  alternatively,  should  the 
group  produce  a consensus  forecast?  How  should  Individual  judgments  be  weight- 
ed mathematically? 

A major  step  toward  an  experimental  answer  to  these  questions,  excepting 
that  of  group  size,  has  been  made  by  Seaver®*'  in  his  study  of  probability 
judgments  by  groups  of  4 people.  The  research  reported  here  used  the  decision 
variable  partition  model  of  subjective  probability^  and  a simple  model  of  the 
effects  of  Interaction  on  judgments  to  simulate  the  group  judgment  of  discrete 
probabilities  investigated  by  Seaver.  The  Initial  results  of  the  simulation 
are  very  promising  in  that  (1)  they  show  the  principal  effects  Seaver  ob*  'ved 
and  (2)  these  effects  can,  for  the  most  part,  be  traced  to  specific  character- 
istics of  the  models.  This  work  may  thus  provide  a basis  for  further  Investi- 
gation of  how  best  to  aggregate  Individual  forecasts. 

SEAVER’ S EXPERIMENT 

Seaver^  investigated  the  performance  of  groups  of  4 people,  acquainted 
with  each  other,  at  making  probability  judgments  about  discrete  events  and 
about  continuous  random  variables.  Only  discrete  events  will  be  considered 
here,  since  the  decision  variable  partition  model  used  in  the  simulation  does 
not,  in  its  present  form,  accomnodate  continuous  distributions.  Seaver  posed 
general  knowledge  questions  of  the  sort:  "Absinthe  Is:  a)  a liqueur  or  (b)  a 

precious  stone."  Group  members  Individually  chose  an  answer  and  recorded  a 
subjective  probability  r,  on  the  half-range  .5  to  1.0,  of  being  correct.  They 
then  interacted  according  to  a prescribed  method  and  then  again  chose  an  answer 
and  recorded  probability  judgments.  In  addition,  they  rated  themselves  and  the 
other  group  members  on  expertise.  Finally,  group  judgi^nts  were  created  by 
different  mathematical  methods  of  weighting  and  combining  the  indlvidu:!  judg- 
ments. 


*This  work  was  supported  by  the  National  Science  Foundation,  Division  of 
Engineering  under  Grant  ENG- 7809365,  "Bayesian  Methodology  for  Ra inflood 
Forecasting  and  Reservoir  Control." 


271 


The  experimental  conditions  for  ¥ih1ch  Seaver  obtained  results,  from  eleven 
groups  with  20  questions  per  group,  are  set  out  In  Table  1.  The  conditions  si- 
mulated by  the  model  are  also  indicated.  The  differences  among  the  types  of 
interaction  are  given  in  Table  2.  Since  Seaver  found  no  reliable  differences 
among  the  interaction  methods,  all  of  which  allowed  individuals  to  consider  the 
judgments  of  others,  the  methods  were  lumped  together  as  interaction  for  model- 
ing purposes. 

The  aggregation  methods  produce  a group  probability  PQ  for  the  correct 
hypothesis  from  individual  probabilities  pi,  i * 1,2, 3,4.  The  value  of  Pi  is 
the  individual's  half-range  response  r\  if  he  chose  correctly  and  (1  - n)  If 
he  did  not.  Similarly,  the  group  response  rg  is  pg  ^ .5  and  (1  - pg)  if  Pq<  .5. 
The  equations  for  pq  under  the  different  aggregation  methods  are  set  out  below, 
w^ere  w^  is  the  weight  assigned  to  the  ith  individual's  judgment,  and  the 
weights  sun  to  one  over  the  group. 

1)  Linear  combination 

4 

Pq  * ^ Pi  0) 

i*l 


2)  Weighted  geometric  mean 

IT 

- . i*i 

~ ^ ~ C2) 

TTPi  ’ ♦ TT  (1  - Pi)  ’ 

i=l  i=l 


3)  Likelihood  ratios 

»G  .4  "l 
TT-TSI  rnTpry 

The  latter  relation  (3)  reduces  to  (2)  when  all  w^-  are  equal  to  one. 

Seaver  used  three  weighting  inethods:  equal,  normalized  self  ratings,  and 
OeGroot'  weights  which  are  determined  for  an  individual  from  others'  ratings  of 
his  expertise.  Since  there  is  no  model  to  predict  the  assignment  of  weights, 
only  the  equal  weight  case  could  be  simulated,  i.e.  w^  » 1/4. 

SEAVER' S RESULTS 

Seaver  summarized  his  results  in  terms  of  1)  a quadratic  scoring  rule  score, 
2)  the  average  probability  assi^ed  to  the  correct  answer,  and  3)  calibration 
curves,  the  plot  of  the  proportion  correct  p(C|r)  as  a function  of  response  r. 

The  actual  proportions  of  correct  response  were  not  reported.  Although  inter- 
action on  the  whole  had  a significant  effect,  the  several  methods  of  interaction 
could  not  be  shown  to  differ  significantly.  In  addition,  the  differences  among 
the  weighting  methods  were  slight,  in  keeping  with  the  results  of  previous  re- 
search.’^ But  it  seems  likely  that  differential  weighting  would  be  advantageous 
if  certain  questions  were  to  require  different  specialized  knowledge  and  the 
groups  were  composed  of  people  with  diverse  expertise. 

Figure  1 shows  the  observed  effects  of  aggregation  and  interaction  on  cali- 
bration. The  frequent  finding  of  over-confidence  for  individuals  is  evident.^ 
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The  results  are  pooled  over  interaction  methods  and  aggregation  methods.  It 
appears,  and  Seaver  concluded,  that  over-confidence  is  reduced  by  aggregation, 
and  that  interaction  increases  over-confidence  for  groups  but  decreases  it  for 
individuals.  Figure  2 shows  the  differential  effects  of  aggregation  method, 
pooled  over  weighting  methods.  Linear  combination  gives  the  least  and  likeli- 
hood ratios  the  most  over-confidence.  For  each  aggregation  method  interaction 
produced  greater  overconfidence. 

THE  MODEL  FOR  GROUP  JUDGMENTS 


Structure  of  the  Model 

The  model  of  subjective  probability  judgments  by  groups  assumes  that  indi- 
viduals initially  make  judgments  in  a manner  described  by  the  decision  variable 
partition  model  of  Ferrell  and  McGoey?  However,  it  is  assumed  that  individual 
judgments  pi  are  then  aggregated  according  to  the  appropriate  mathematical 
scheme.  When  there  is  interaction,  a deterministic  model  of  the  effects  of  the 
group  on  individual  opinion  is  applied  to  modify  the  p^  values  before  aggregat- 
ing them  into  a group  opinion.  The  model  of  interaction  attempts  to  take  ac- 
count of  two  phenomena  frequently  observed  in  small  groups,  conformity’  and 
polari  zation.5 

The  Decision  Variable  Partition  Model 

The  decision  variable  partition  model  of  calibration^,  applied  to  two  alter- 
native forced  choice  questions  of  the  sort  used  in  Seaver's  study,  assumes  that 
consideration  of  each  answer  by  each  individual  generates  a scalar  random  va- 
riable Y which  is  differently  distributed  for  correct  answers  C than  for  incor- 
rect ones  C.  For  simplicity,  normal  distributions  are  assumed; 
f(y|C)  = <i(y  - d'/2)  and  f(ylC)  = i>(y  + d'/2),  where  it  is  the  probability  den- 
sity function  of  the  standard  normal  and  d'  is  a parameter  of  the  model.  The 
individual  chooses  as  correct  the  answer  that  gives  the  larger  value  of  Y,  y(l), 
and  bases  his  judgment  of  confiaence  on  the  difference  between  the  values  of  the 
two  variables  y(l)  - y(2).  Let  X » Y(l)  - Y(2),  X ^ 0.  The  individual  .parti- 
tions the  range  of  X into  m intervals  by  the  set  of  cutoff  values  {x’!,  asso- 
ciating with  each  interval  a member  of  the  allowed  set  of  m probability  respon- 
ses {ril.  The  partition  is  selected,  within  the  limits  of  the  individual's 
knowledge,  to  achieve  good  calibration,  The  expected  values  of  the  resulting 
calibration  can  be  determined  from{x’}  and  the  distributions  of  X conditional 
on  correct  and  incorrect  choice. 

When  the  Y distributions  are  assumed  ngrmal,  as  above,  the  distributions  of 
X are  readily  found  to  be:  f(x|C)  = » ( -—  a-)  truncated  below  at  x * 0,  and 

JT 

) a1?o  truncated  below  at  x = 0.  The  expected  values  of  the 

/Z 

calibration  proportions,  p(C|r^)  ar^  found  in  general  by 

p(Cir.) 

' p(C)[F(x’lO  - F(x’-V)]  + [1  - P(C)][F(x’|C)  - F(x’-'|C)]  (4) 

where  p(C)  is  the  proportion  of  correct  choices  and  F is  the  cumulative  distri- 
bution function.  For  the  present  case,  the  values  of  p(C)  and  [1  - p(C)]  that 
weight  the  truncated  normals  cancel  with  those  in  (4)  to  give 
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where  ‘^is  the  cumulative  distribution  function  of  the  standard  normal, 
rameter  d*  is  related  to  the  proportion  of  correct  choices  by 


p(C)  » 4>(d7»^). 


(5) 


The  pa- 

ce) 


Figure  3 shows  a partition  that  gives  approximately  perfect  calibration  for 
d‘  “ 1 (p(C)  » .76).  Perfect  calibration  is  not  always  possible.  Figure  4 
shows  the  calibration  curves  that  result  from  holding  a partition  constant  and 
varying  p(C). 

It  was  concluded  by  Ferrell  and  McGoey^  that  people  tend,  unless  given 
feedback  about  calibration,  to  use  a partition  suited  to  a value  of  p(C)  around 
.75  regardless  of  tne  difficulty  of  the  questions.  An  example  of  the  model, 
with  constant  {x^},  fitteo  :o  calibration  results  from  Lichtenstein  and 
Fischhoff^  is  shown  in  Figure  5.  The  effect  of  P(C)  is  clearly  evident. 


The  Interaction  Model 

Knowledge  of  other  group  members'  views  is  assumed  to  affect  each  member's 
confidence  which  is  represented  in  the  model  by  the  decision  variable  X.  For 
computational  convenience,  the  range  of  the  decision  variable  X is  taken  to  be 
the  entire  real  line,  with  negative  values  indicating  choice  of  the  incorrect 
alternative  and  positive  ones  choice  of  the  correct  one.  The  partition  {x^}  is 
synmetric  about  x » 0,  with  intervals  on  the  negative  range  producing  the  same 
subjective  probability  responses  r as  those  in  the  corresponding  interval  on 
the  positive  range,  but  being  associated  with  the  incorrect  answer. 

Interaction,  in  the  model,  operates  thusly:  an  individual's  initial  value 
of  x is  influenced  by  the  average  X3  of  the  x values  of  the  other  three  members 
to  give  a new  individual  value  x'  according  to 


X*  » X + k-j  (x^  - x)  + k2  x^. 


0 < k^  < 1, 

0 < k2  < 1. 


(7) 


The  first  term  mimics  conformity  in  that  the  value  of  x (confidence  in  *.ifc  right 
answer)  moves  toward  the  mean  of  the  other  members'  confidence.  ”he  second  term 
mimics  extremity  shift  in  that  the  value  of  x moves  in  the  positi.a  or  negative 
direction  depending  on  whether  the  mean  of  the  other  members'  feelings  is  posi- 
tive or  negative.  The  individual  member's  new  confidence  x'  is  transformed  in- 
to a response  r in  the  same  way  as  the  original  value.  And,  in  all  cases,  aggre- 
gation to  give  a group  judgment  is  performed  only  upon  the  responses  (or  one 
minus  them  if  the  individual  chose  wrongly)  not  upon  the  x values,  which  are 
assumed  not  to  be  explicitly  available  in  numerical  form. 

^he  Simulation 

The  simulation  program  (available  from  the  authors)  computes  four  pseudo 
random  numbers  x^ , with  intercorrelation  p,  distributed  normally  with  mean 
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fJT~ and  variance  i.O.  These  are  the  group  meffibers*  initial  confidence  esti- 
mates, Negative  values  indicate  preference  for  the  incorrect  alternative.  All 
individuals  are  assumed  exactly  alike  in  their  proportion  of  correct  responses 
(see  equation  6)  and  in  their  partitions  {x^}.  These  are  only  approximations, 
and  ¥fould  still  be  so  even  if  the  model  of  individual  behavior  were  exact.  The 
intercorrelation  reflects  the  commonality  of  shared  information.  Each  group 
member  dees  not  have  entirely  independent  information  about  tne  correct  answer. 

The  initial  values  of  x for  the  group  members  are  transformed  into  response 
values  r by  the  partition  and  the  results  contribute  to  the  simulation  of 
individuals  before  interaction.  The  response  values  are  then  aggregated  accord- 
ing tc  ^ua t i ons  ( 1 ) , ( 2J  and  (3)  to  contribute  to  calibration  proportions  for 
groups  before  interaction.  The  x values  are  then  transformed  by  equation  (7) 
and  responses  calculated  according  to  the  partition  and  these  contribute  to 
calibration  statistics  for  individuals  and  groups  after  interaction.  Simulation 
of  25,OOC  groups  (100.000  in^ividualsT  gives  stable  calibration  proportions. 

SIMULATION  RESULTS 


Model  Parameters 

The  decision  variable  partition  model  was  fitted  to  the  experimental  cali- 
bration curve  for  individuals  before  interaction  shown  in  Figure  1.  The  degree 
of  cver-confidence  suggested  a proportion  correct  p(C)  = .65  and  thus  a value 
of  c:'  = 545.  With  an  interactive  computer  program  an  approximate  fit  to  the 
datii  was  obtained  with 

{ xi}  = {0,  .2.  .36.  .53.  1.045.  *}. 

The  other  parameters  were  chosen  unsystematically,  but  with  a view  toward  pro- 
ducing Ctilibration  curves  that  resenbled  those  obtained  by  Seaver.  If  his  data 
were  available,  it  might  be  possible  to  estimate  the  parameters  from  it.  How- 
ev6‘^.  ob:aining  suitable  values  was  not  difficult,  i.e.,  the  effects  are  not 
der>enden:  on  critical  parameter  values,  and  the  values  chosen  also  seem  plausi- 
bl^j  a priori . Parameters  used  were:  p=.4,  the  member's  intercorrelation;  k^*.l 
thj  conTormity  parameter;  and  k2=.2  ths  polarization  parameter. 

Model  Results 

figure  6 shows  calibration  curves  from  Seaver^  which  allow  comparison  be- 
ti^een  individuals  and  the  equally  weighted  linear  combination  (i.e.,  the  aver- 
a^elof  group  membevs'  judgments.  Figure  7 shows  the  results  of  the  model  for 
tfi6  same  conditions.  The  effects  found  by  Seaver  are  clearly  evident  in  the 
model's  output.  Over-confidence  is  markedly  reduced  by  taking  the  group  average, 
and  interaction  has  the  opposite  effect  on  groups  that  it  has  on  individuals. 

With  individual  judgments,  the  conformity  effect  makes  them  slightly  resemble 
g^'oup  judgments,  and  thus  less  over-confident,  and  the  polarization  efrect  makes 
tnem  somewhat  larger,  tr»us  more  over-confident.  The  net  result  is  slightly  less 
over-confident  after  interaction  for  individual  judgments.  With  groups,  on  the 
other  hand,  tne  conformity  etfeci  is  already  at  a maximum,  because  of  the  explic- 
it averaging,  so  polarization  due  to  interaction  makes  the  judgments  more  ex- 
treme and  increases  over-confidence.  Note  that,  in  the  model,  the  fact  that 
crou  judgments  are  better  calibrated  than  the  individual  judgments  is  simply  a 
consequence  of  the  fact  that  the  Individuals  are  over-confident  to  begin  with, 
/averaging  their  responses  improves  the  prgportion  correct  p(C)  (from  .64  to  .71 
n this  casu)  and  with  fixed  partition  {x^}  this  causes  a reduction  in  over- 
confidence.  Had  the  individual  group  members  been  well  calibrated,  the  groups 
would  have  proved  to  be  under-confident,  and  interaction  would  reduce  tne 
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under-confidence  for  groups  and  increase  it  for  individuals.  This  predicted 
effect  is  shown  in  Figure  8.  in  which  the  group  calibration  is  the  worst, 
but  still  least  over-confident.  It  would  be  interesting  to  test  this  pre- 
diction empirically. 

The  effects  cf  the  different  aggregation  methods  (equations  1.2.  3) 
as  found  by  Seaver  are  shown  in  Figure  9.  to  be  compared  with  output  from 
the  model  in  Figure  10.  Again  the  model  reflects  Seaver’s  findings  in  that 
the  geometric  mean  and  the  likelihood  ratio  methods  of  aggregation  compen- 
sate less  well  for  the  over-confidence  of  individual  members.  Each  of  these 
methods  gives  more  extreme  values  (and  thus  more  over-confidence)  than  the 
simple  average,  at  least  when  the  component  values  tend  to  agree,  the  like- 
lihood ratio  giving  much  more  extreme  values.  The  model  does  not  give  re- 
sults for  the  likeliRbo3  ratio  method  as  close  to  Seaver* s as  it  dees  for 
tne  other  methods,  and  this  may  be  due  to  its  extremeness  interacting  with 
the  rather  coarse  partition  (m  ■ 5 response  categories). 

The  model  results  in  terms  of  quadratic  score  and  average  response 
probability  for  each  condition  have  been  computed.  The  model  scores  are  much 
higher  than  those  Seaver  found  and  this  may  be  due  to  the  assumed  proportion 
of  correct  response  being  too  high.  The  average  response  probabilities  from 
the  model  are  somewhat  too  high  but  they  follow  the  same  pattern  over  con- 
ditions as  Seaver  reports.  Since  the  model  was  not  fitted  in  any  precise 
way  and  has  been  used  only  to  demonstrate  that  it  reproduces  the  structure 
of  the  experimental  results,  the  numerical  values  are  not  included  here.  If 
mode^  parameters  could  be  estimated  from  data,  however,  it  would  be  important 
to  Inok  for  consistency  at  such  a level.  But  the  data  Is  not  yet  available. 

CONCLUSIONS 

Seaver’s  basic  findings  about  calibration  of  group  and  individual  ois- 
crete  probability  judgments  can  be  accounted  for  in  a consistent  and  in- 
tuitively satisfying  way  by  the  decision  variable  partition  model  of  individ- 
ual subjective  probability  judgment  coupled  with  a simple  linear  model  of  the 
effects  of  group  interaction  on  Individual  certainty.  The  effects  Seaver 
reports  are  then  due  to  two  competing  influences.  The  first  Is  grouping, 
whereby  combining  judgments  leads  to  a greater  proportion  of  correct  responses 
and  thereby  to  reduced  over-confidence  or  even  under-confidence.  The  effect 
is  the  same  as  that  of  an  increase  In  p(C)  on  individual  calibration.  The 
second  influence  is  extremeness  whereby  the  judgments  are  made  larger  and 
thereby  increase  over-confidence. 

Aggregation  methods  all  manifest  grouping  to  some  extent,  but  of  those 
considered  only  linear  averaging  avoids  introducing  extremeness  effects 
which  tend  to  counteract  the  effect  of  grouping  on  reduction  of  over- 
confidence.  Intercorrelation  of  individual  Judgments  also  counters  the  ef- 
fects of  grouping.  Group  interaction  also  combines  grouping,  as  a manifes- 
tation 0^  conformity,  and  extremeness  as  a manifestation  of  polarization.  These 
psychological  characteristics  of  interaction  are  widely  observed  and  reported. 

The  practical  Implications  of  these  findings  for  aggregating  group 
judgments  are  substantial. 

1.  The  quality  of  calibration  of  aggregated  judgments  depends,  in  a 
complex  but  predictable  way,  on  the  quality  of  individual  cali- 
bration. If  Individuals  are  quite  over-confident  groups  will  be 
less  so,  but  if  individuals  are  well  calibrated,  groups  will  be 
under-confident.  This  result  has  not  been  reported  but  is  predicted. 
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2.  Aggregation  methods  can  be  tested  beforehand  for  their  Influences 
on  calibration. 

3.  Interaction,  for  questions  of  the  sort  studied  by  Seaver,  is  of  no 
practical  value  since  its  beneficial  effects  of  grouping  can  be 
obtained  by  averaging. 

4.  If  Individual  calibrations  were  known,  the  effects  of  aggregation 
could  be  predicted  and  the  aggregation  method  adjusted  to  give 
perfectly  calibrated  group  judgments. 
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VISUAL/MOTION  CUE  MISMATCH  DURING  A COORDINATED  ROLL  MANEUVER 

D.  K.  Shirachi 

Computer  Sciences  Corporation 
Mountain  View,  California 

ABSTRACT 

Two  major  factors  involved  in  creating  realistic  simulations  are  the  visual 
and  motion  systems  which  provide  important  cues  of  vehicular  attitude, 
velocities  and  accelerations  to  the  pilot  for  purposes  of  stable  coficr-ol 
and  simulation  realism.  However,  it  is  difficult  to  match  the  dynamic 
response  characteristics  of  these  two  display  systems  to  each  other  because 
of  the  inherently  higher  inertia,  limited  available  power  and  constrained 
positioning  for  the  motion  system.  Furthermore,  as  a means  of  dynamically 
compensating  for  simulator  dimensional  constraints,  washout  filters  are 
used  which  in  turn  modify  the  frequency  characteristics  of  the  motion 
simulator. 

The  purposes  of  this  experiment  were  to  determine  the  following: 

(1)  the  effect  of  a performance  mismatch  between  the  simulator  visual  and 
motion  display  systems  on  pilot  performance  while  engaged  in  a compensatory 
tracking  task,  and 

(2)  the  effect  of  a reduction  in  simulator  motion  scaling,  maintaining 
constant  visual  scaling,  on  pilot  performance  for  this  same  task. 

A jet  transport  aircraft  with  motion  in  the  roll  and  lateral  simulator 
axes  was  used  as  a test  vehicle  for  this  computer  simulation  investigation. 
The  aircraft  was  disturbed  by  moderate  levels  of  turbulence  which  resulted 
in  flight  path  deviations  in  the  roll  and  lateral  axes.  The  pilot's  task 
was  to  maintain  flight  formation  behind  the  aircraft  In  front  of  him  as 
displayed  by  a video  monitor  located  in  the  simulator  cockpit. 

Experimental  data  consisting  of  pilot  describing  functions  and  pilot 
performance  scores  are  presented  and  discussed  as  they  relate  to  previously 
published  experimental  evidence. 
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COMBINED  EFFECT  OF  THE  OCULOGYRAL  ILLUSION  AND  OF  A FIXED  PERIPHERAL  FIELD  OH 

SENSATIONS  OF  YAU  MOTION 

J.K.  HUANG  AND  L.R.  YOUNG 
Man  Vehicle  Laboratory,  M.l.T. 


INTRODUCTION 

It  is  k^el  I known  that  visual  and  vestibular  information  interact  in  perception 
of  spatial  orientation  and  in  pilot  control  tasks.  The  perception  of  self* 
rotation  while  viewing  an  isolated  visual  target  rotating  with  the  subject  is 
Several  times  more  sensitive  than  without  the  target.^  This  is  the  oculogyral 
illusion^  (OGI)  and  thresholds  for  OGI  are  significantly  lower  than  thresholds 
in  the  dark.  In  contrast*  measurements  of  vestibular  nucleus  unit  activity  in 
rotating  alert  monkeys  show  that  the  firing  rate  wi th  a conf I let ing  visual  field 
is  significantly  lower  than  the  firing  rate  in  the  dark*^^  indicating  that  the 
threshold  for  perception  of  self-rotation  could  be  lower  in  the  latter  case. 

The  purpose  of  this  v#ork  was  to  study  the  combined  effect  of  the  oculogyral  Il- 
lusion and  of  a fixed  peripheral  visual  field  on  sensations  of  rotation  about 
a vertical  axis. 

METHODS 

Subjects  were  seated  in  a rotatable  L.:?iner  with  four  possible  visual  fields: 

OK  (dark);  DM  (a  dim  peripheral  field  fixed  with  respec  :o  the  subject  - 60  fc 
illumination  near  the  bulb);  LT  (the  same  as  DM*  but  witn  80  fc);  and  OGI  (only 
a fixed  spot  can  be  seen).  For  DK,  DM  and  LT*  the  subjects  partiepated  in  three 
sub-experiments:  Threshold  measurement,  closed-loop  velocity  nulling*  and  open- 
loop  magnitude  estimation.  A total  of  13  male  subjects  participated*  aged  22 
to  29*  in  normal  health. 

A modified  Link  GAT- I trainer*  driven  as  a velocity  dependent  servo*  rotates 
about  the  vertical  axis.'^  During  LT  and  DM*  a projector  presents  a vertical 
stripe  pattern  to  the  subject  via  two  translucent  side  windows.  A 1'*  diameter 
white  spot  is  fixed  30"  in  front  of  the  subject.  For  OK*  the  subject  is  blind- 
foled  with  eyes  open.  For  the  closed-loop  velocity  nulling  method,  a feature- 
less control  wheel  in  the  horizontal  plane  In  front  of  the  subject  is  used  to 
null  the  trainer  velocity.  For  the  open  loop  magnitude  estimation  method*  a 
pen  was  affixed  at  the  edge  of  the  wheel  and  the  subject  asked  to  use  I t as  a 
pointer  to  a laboratory  fixed  location. 

Threshold  measurement;  Six  subjects  were  instructed  to  use  the  wheel  to  indi- 
cate the  direction  of  rotation  as  soon  as  possible.  All  had  six  randomized 
sessions.  In  each*  six  accelerations  were  used  with  periods  of  15  s and  with 
30  s between  stimuli.  C losed- loop  ve loci ty  nulling  method:  The  trainer  was 
driven  by  a disturbance  signal  d which  is  a pseudo- random*  zero-mean*  velocity 
command  signal  with  a period  of  409.6  s*  consisting  of  a sum  of  12  sinusoids 
spanning  the  range  from  0.007  to  0.715  Hz.  Four  subjects  were  instructed  to 
use  the  wheel  to  keep  the  trainer  as  motionless  as  possible  by  concentrating 
on  their  sensed  angular  velocity.  The  wheel  deflection  was  added  to  the  dis- 
turbance to  drive  the  trainer  with  a net  velocity  u).  The  subject  was  trained 
to  null  the  velocity  as  best  he  could  and  was  given  the  same  six  sessions  as 
before  with  four  minute  intervals  between  runs.  A separate  experiment  compared 
conditions  in  OK  and  OGI  with  four  runs  for  each  subject  (two  each  for  OK  and 
OGI).  Open  loop  magnitude  estimation  method:  The  subject  was  required  to  es- 

timate his  rotational  displacement  relative  to  a fixed  laboratory  frame  for  two 
types  of  stimuli  - triangular  (TRI)  and  trapezoidal  (TRZ)  waveforms.  TRI  wave- 
forms were  selected  as  they  approximate  stimuli  experienced  In  natural  motion 
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and  avoid  difficulties  with  unnatural  stimulation.^  Six  subjects  were  instri\i* 
ted  to  move  the  pointer  in  a compensatory  direction  so  that  it  maintained  a 
fixed  (compass)  headin9  as  the  trainer  was  rotated.  After  practice,  the  same 
six  sessions  were  given.  In  each,  seven  TRI  stimulations  with  four  types  of 
acceleration  were  used  with  30  s between  stimuli.  To  investigate  open  loop 
magnitude  estimates  during  sudden  decelerations,  two  stimuli  were  constructed 
as  follows:  5"/s^  acceleration  to  a constant  velocity  of  30*/s  for  20  to  26  s, 

followed  by  a deceleration  of  l5®/s^  or  20*/s^  to  zero.  Because  of  the  long  and 
different  durations  of  constant  peak  velocity,  the  subject  senses  both  himself 
and  the  trainer  in  a st^tionary  state  until  the  onset  of  the  upredictable  decel* 
eration  causes  an  af ter-rotat ion  effect  in  the  opposite  direction.  The  subject 
was  asked  to  ignore  the  first  acceleration,  but  to  perform  the  same  pointing 
task  as  before  to  show  the  after-rotation  effect.  There  were  again  six  sessions, 
each  using  two  types  of  deceleration,  with  one  minute  between  each.  Subjects 
were  instructed  to  look  at  the  white  spot  during  LT  and  DM. 

RESULTS 


Threshold  measurement:  The  latency  time  f perception  of  angular  rotation  was 

measured.  All  the  data  were  averaged  and  ^re  plotted  in  Fig.  1.  along  with 
other  result$2*li  corresponding  to  DK  stimuli.  The  'Mulder  Product',  ax  (accel- 
eration X latency)  ■ K,  is  plotted  to  fit  the  data  for  each  visual  presentation. 
A ^-test  shows  no  significant 


difference  between  the  DM  and 
LT.  However,  the  threshold  for 
the  DM  and  LT  stimuli  is  sign- 
ificantly lower  than  the  thres- 
hold in  the  DK. 

Closed- loop  velocity  nulling 
method:  Using  the  same  analy- 

sis techniques  established  by 
Zacharlasjn  the  describing 
function  can  be  evaluated  after 
Fast  Fourier  Transformation  of 
the  wheel  input  and  trainer 
output  signals  i n the  frequency 
domain.  The  amplitude  ratio 
data  were  obtained  by  pooling 
the  subject  data  across  the 
test  population.  The  parameter 
values  of  a lag  lead  transfer 
function  were  obtained  from 
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a nonlinear  regression  program  providing  a least-squares  parameter  fit  to  the 
data. 3 A dead  time  is  added  to  the  phase  data  to  obtain  a better  fit.  The  AR 
asymptotes  and  the  values  of  all  parameters  are  shown  in  Fig.  2. 


The  gains  for  the  LT  (or  DM)  and  DK,  at  the  low  frequency,  are  significantly 
different,  as  is  T2-  The  changes  in  Xi  and  arc  not  significantly  different. 
Although  the  gain  for  the  LT  is  slightly  higher  than  that  for  DM,  the  di f ference 
is  not  significant  nor  is  that  in  i2  for  the  LT  and  DM.  Furthermore,  the  high- 
est gain  was  in  OGI  and  all  subjects  stated  that  there  was  a clear  oculogyral 
illusion  wht'-h  they  could  use  to  detect  the  direction  of  se I f-rotat ion  or  to 
estimate  thn  rnagnitude  of  velocity.  This  was  especially  true  at  low  frequency 
and  acceleration. 
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Open  loop  magnitude  es-* 
timation  method:  The 

mean  and  standard  devi- 
ation magnitude  esti- 
mates of  the  actual 
motion  with  the  TRI 
stimuli  are  shown  in  7 
Fig.  3*  Por  a ■ 5*/s^,  s 
the  subjective  displace- 3 
ment  is  quita  near  the  ^ 
actual  displacement  and  j 
the  subjects  tended  to 
underestimate  more  when 
the  duration  of  the  wave- 
form increases.  This  is 
to  be  expected  on  the 
bas i s of  cupul a displace- 
ment, relative  to  velo- 
city, during  constant 

acceleration.^  Although  the  means  are  slightly  higher  in  the  OK,  analysis  of 
the  raw  data  shows  that  this  Is  not  significant. 

For  TRZ  stimulation,  the  subjective  velocity  was  calculated  from  the  disk  posi* 
tion  after  the  beginning  of  deceleration  and  the  means  are  plotted  In  Fig.  k for 
20^/s^.  From  the  raw  data,  we  find  that  each  subject  showed  smaller  subjective 
velocity  in  the  OK  for  both  decelerations,  although  the  difference  is  not  sig-> 
nif leant.  In  the  OK,  the  subjective  velocity  rises  more  slowly  and  reaches  a 
smaller  peak  than  it  does  in  the  DM  or  LT.  For  15*/$^»  the  result  is  similar* 

DISCUSSION  • 

Threshold  measurement:  Several  Investigators 

have  measured  the  threshold  for  perception  of 
acceleration  about  the  vertical,  however,  one 
should  be  aware  that  there  is  a 1 imi ted  region 
of  applicability  of  the  Mulder  product. 1 t 2, 1 1 \ 

Xfi  was  found  as  O.k  s at  a“'»0,  by  plotting  K 
a*‘  VST.  By  using  t'  ■ In  Fig.  5#  the 

data  were  fitted  with  the  whole  region  of 
a(t-T^)^  • K,  a revised  form  of  or ■ K.  The  ^ 
parameter  values  were  obtained  from  a non-  ^ 
linear  regression  program. 5 |n  Fig.  I,  the  ^ 
data  show  a shorter  latency  time  In  OM  or  LT  ^ 
compared  to  OK  for  all  subjects.  We  propose  g 
that  since  the  subject  first  senses  the  mot-  | 
ion  of  the  white  spot  and  later  his  self-  c 
rotation  in  the  same  direction,  he  "learns"  5 
to  sense  the  self-rotat ion  at  the  onset  of 
the  oculogyral  illusion  and  achieves  a lower 
threshold.  Marshall^®  found  the  same  effect. 

Another  possible  explanation  of  the  longer 
latency  in  the  dark  is  that,  because  of  dizz- 
iness or  d i sor ientat ion,  the  signal  from  the 
vestibular  nucleus  is  processed  with  a higher 
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threshold  and  has  longer  latency.  The  alertness  of  the  subject  In  the  DM  and 
LT  fields  may  also  be  a reason  for  the  low  threshold  with  the  OG 1.3*7  Henn  et 
a]3  showed  that  alertness  changes^  evident  in  eye  movements^  did  not  affect  the 
vestibular  nucleus  units'  response  to  angular  acceleration.  From  Fig.  ),  it 
can  be  seen  that  there  is  no  significant  difference  between  the  DH  and  LT.  For 
0.5*/s^  acceleration,  it  is  interesting  that  every  subject  showed  o shorter 
latency  time  in  DM.  Higher  i I luminat ion  wi 1 1 increase  the  non- uni  form i ty  of 
the  background  and  increase  the  sensation  of  stationarity  of  the  stripes. ^ This 
may  explain  the  higher  threshold  in  LT  and  DM  and  also  the  higher  thresholds  in 
light  found  by  Waespe  et  al.^^ 

Closed-loop  velocity  nulling  method:  The  gain  in  LT  (or  DM)  is  hight^r  than  in 

DK  (Fig.  2a).  The  difference  appears  at  frequencies  below  0.06  Hz.  Here»ais 
below  2.4l‘*/s^(from  disturbance  frequency  spectrum),  and  the  threshold  is  sig- 
nificantly lower  in  the  DK  with  smaller  a (Fig.  1).  The  oculogyral  Illusion 
presumably  produces  the  lower  threshold  and  results  in  greater  sensitivity  and 
a higher  gain  for  nulling  rotation  in  LT  (or  DM). 


Open  loop  magnitude  estimation  method:  With  TRI  stimutatfon,  the  magnitude 

estimates  of  the  actual  motion  showed  no  significant  difference  between  DK,  OM 
and  LT.  Because  ofthe  strong  stimulation  and  short  duration,  such  a stimulus 
can  be  regarded  as  similar  to  a mid  or  high  frequency  sinusoidal  stimulus.  The 
vestibular  system  can  sense  the  motion  quickly  and  the  judgment  presumably  does 
not  rely  upon  the  effect  of  visual  input.  These  results  are  confirmed  by  those 
of  the  first  experiment.  For  the  TR2  stimulation,  we  found  a quicker  rising 
speed,  larger  subjective  velocity,  and  longer  duration  of  the  after-rotation 
effect  in  the  illuminated  presentation  than  in  the  OK  jnd  we  can  expect-  to  find 
greater  differences  with  lower  intensity  st imulat Ion . H 
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CONCLUSIONS 

AM  of  the  current  results  concerning  detection  and  reaction  to  angular  accel- 
eration in  the  dark  and  with  a fixed  visual  field  show  that*  for  low  accelera- 
tions, the  visual  Input  enhances  the  sensitivity  to  self-motion  Since  the 
visual  surround  is  fixed  with  respect  to  the  subject,  and  might  imply  a "no 
motion"  or  null  signal  if  interpreted  as  a ci rcularvecticn  Input,  It  conflicts 
with  the  true  rotation  sensed  by  the  semicircular  canals  and  might  be  expected 
to  inhibit  the  motion  sensation.  Furthermore,  vestibular  nucleus  unit  activity 
was  shown  15  to  be  inhibited  by  a fixed  visual  surround  In  slmilsr  circumstance: 
and  compensatory  eye  movements  are  suppressed  by  visual  fixation.  We  r>^^ributd 
the  enhancement  at  low  acceleration  to  the  sensitive  motion  detect I c ociated 
with  the  oculogyral  illusion  of  relative  motion  of  a fixed  spot  dur<  ^ject 
rotat ion. 
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letroducrlon: 

Uhofi  a huuaa  U subjected  to  a G field  stress  enelrooMnt,  the  effect  of 
this  stress  variable  on  tracking  performance  can  be  studied  several  ways*  This 
papej  will  conduct  a performance  analysis  on  data  from  an  experlaent  designed 
at  Che  Air  Force  Aerospace  'ledlcal  Research  Laboratory  by  an  effort  la  cooper 
atloa  with  the  University  of  Connect  lent*  The  details  of  this  experleent  have 
been  veil  docunented  and  this  study  has  provided  an  Interesclnc  data  base  idiich 
Ulttstrates  the  degradation  of  tracking  performance  as  the  hsnsn  Is  sebjected 
to  the  envirofssental  stressor  (1*4).  The  prlnety  gosi  of  this  esperlMet  mm  to 
obtain  data  for  developing  eodels  oclllslng  the  Opclnsl  Control  Sfodel*  Since 
this  study  has  provided  a data  base  vhlch  shoes  perfomsnee  changes  under  the 
stress  condition,  the  work  eonducced  here  is  concerned  with  defining  note 
explicitly  the  performnee  changes  aod  exanlelng  statistical  properties  of 
IniBsn  tracking  with  and  wlchouc  the  stress  effects* 

The  extant  Uteratere  on  the  study  of  the  effect  on  hnnsns  of  accelerecloe 
stress  Is  extensive*  One  nensore  of  the  anouat  of  lltetatum  available  can  bn 
seen  In  the  classic  work  of  Fraser  (5)  which  lists  199  references  In  the  srea 
at  that  point  In  Clnn*  Thn  pnper  by  Brown  (6)  lists  100  refnrences  and  gelte 
Interestingly  dnflnes  hsnnn*s  perfomsnee  under  these  stress  fields  in  several 
different  ways.  Thn  cam  perfomsnee  can  hn  need  to  descrlbn  toleranca  Units, 
chsttgns  In  rasctlon  tine,  proprioceptive  changes,  visual  parceptloa  leM, 
degradatloa  la  scores  obtained  fron  different  notor  related  tasks,  and  e 
variety  of  physiological  indicators  or  neasarensats  uadar  tha  strasa  cenditioa 
oa  huasttS* 

Since  the  definition  of  bneen  perfomsnee  hen  eeny  laterpretetlons  in  the 
eccelcretlon  stress  ores.  It  was  decided  la  this  pnper  to  look  at 
perfomsnee  using  an  extension  of  a phase  plane  technlgee  (7)«  There  are  ewe 
guestloas  to  be  addressed  here  with  respect  to  hensn  tracking*  first  It  is 
desired  to  better  understand  bow  hsnsn  tracking  diangas  under  the  exposure  to 
the  stress  condition*  One  object  of  this  lavestigstloa  Is  to  aeke  oJ^Ucit 
statenents  about  tna  perfomance  chaagas  due  to  tha  scresa  axponam  In  lien  of 
asking  heuristic  argunents  using  conventional  naasates  of  tracking  perfomsnee* 
The  goal  hera  is  to  eake  none  gnaatltatlve  detemiaatloe  of  how  tha  stress 
effects  the  perfomsnee  chsrecterlsties  of  huhsa*s  tracking  In  the  loop*  The 
guancltatlve  decctalnaclon  of  stress  effects  oe  perfomsnee  will  be  defined 
eore  explicitly  in  terns  of  peraaeters  of  a density  function  Identified  fron 
Che  enptrical  data* 

A second  objective  of  this  study  is  to  decemine  exactly  what  Che 
distribution  functions  are -which  chsrecterlxe  tracking  in  a phase  plane 
representation  of  the  closed  loop  error  signal*  Thn  asseapclon  In  (7)  was  that 
Che  distributions  of  the  error  signal  and  its  derivative  la  the  phase  plane 
were  nocnal*  The  credibility  of  that  assusptloe  will  be  tested  In  this  paper 
for  a different  tracking  task  and  across  a nunber  of  subjects*  The  data  base 
(l-*>4)  will  be  used  to  examine  the  distributions  of  the  error  signal  and  the 
first  derivative  of  the  error  signal.  This  enplrlcsl  data  will  be  studied  usleg 
a test  for  nomsllcy  (8,9,10.11).  The  Identified  ««edlans  becone  the  boundaries 
of  the  ph«tse  plane  on  their  resrectlve  axes;  the  identified  variances  Indicate 
the  confidence  In  this  estloatc  of  the  median  value* 

A z^scstlstic  Is  used  to  Uersmlne  If  the  aedlans  aod  variances  of  the 
*eaplrlcal  data  she-  a slani: leant  change  (l.e.  In  cHe  phase  plane  boundaries) 
bccvccn  chc  stre.;sed  condition  and  the  iion^;tressed  condition*  This  test  which 
has  the  property  cf  being  "distribution  free",  ptovides  the  fraaswork  to  eoke  a 
scatcri  nt  about  ^hc  sir.nlllcant  pcrfarcancc  cltangus  due  Co  the  stressed 
coivJIt!  'tn  without  the  ion  of  norrtality  coananly  used  with  t^cests*  Also, 

itr.i;;,:  tiiis  / tnril  . on,  it  1 po'ssihlc  to  cx.iainc  the  assnaptlon  of  nomalicy 
ur  cho  disc cihiit inn  fnncCionri  frcrfa  chc  caplricaL  data  vhlch  characterize  the 
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plwiM  rt«tnc  Ttw  .instiMiitioii  of  imicmIIcv  far  the  41etrlh«itlo«i 

fnncLtoii;i  a(  i;««  i>*'rtarnanco  vartablen  ci«*«y  not  boM  hare  b^cannc  the  forcing 
function  ii«od  In  tbit  tcu«iy  it  mum  of  tlnct  tihicb  illffcrt  froo  the 
dotomliuttic  cracking  cotk  considered  in  (7). 

The  C K1cl»l  : 


M>  Qxperinriu  idiicii  rise  to  the  date  bnse  used  hero  has  been 
extensively  docutiented  in  la  this  OAfMtr  the  data  used  in  this  eaelysis 

ulll  consider  two  of  the«  phases  of  this  experiment  Flsure  (la)  llluetretee  a 
block  diagram  of  t human  involved  In  this  maa'^machine  iateractioa.  to  deeerihe 
this  type  of  envlconMatal  st roster,  tlie  term  *open  loop  streae"  Is  used 
because  the  C stress  field  Is  applied  to  the  human  and  he  caaaot  change  this 
stress  field  tlirougli  his  stick  cumnaads*  figure  (lb)  illustrates  phase  tl  of 
this  experiment  uhlch  is  teemed,  ^closed  loop  stress'* • la  this  case  the  humsa's 
stick  commands  increase  the  stress  level  and  thus  penalise  the  subject  for 
making  theao  stick  coemmada  in  his  tracking  response,  figure  (2)  llluetretee 
the  convent lomsl  definitions  of  cho  C stross  flold  vectors  uasd  in  Air  foren 
rslstsd  applications*  Using  tho  roctor  dnfinitions  in  figuro  f2)*  tho  opoa  sad 
closod  loop  portions  of  this  oxporlmsnc  can  bo  doflnod  oa  folloua: 
fhaso  1; 

6pan  Loop  Strosaz  Cs^*0-  Cx«2*0.  Cy«0*0i  tho  tsrgot  input  coaoiatod  of  • f 3 
socoad  compofiaatory  trackiag  task  (aum  of  aicioo.  toro  moaa. 
coaotaat  variaaco). 

^ao  II: 

Cloaod  Loop  Strooo:  Sa«  3*0.  Gx»2*0.  ulth  two  lovmls  of  Gy  «mfiamd  aa  fclimuot 
Lorn  Lavol  GytCy  ci  ^ I paak  to  peak  (0*7  MS)  **  Sama  Trackiag  Task 
lil jn^voT^ :Gy  2 p^k  to  poak  (l*A  Ml)  • Sama  Trackiag  tkok 
Duriag  a dally  rua  of  tho  oxporimoat.  oack  oukjoct  tracked  ems  93  aecomd 
trackiag  tasks  (sum  of  sineo)  ststic  smd  tkoa  osperloueod  two  street  sapssnres 
of  93  socoads  oack  (with  tho  oame  trackiag  task)*  Aftor  tka  streao  oi^oeera. 
cho  subjoct  was  ceguirod  to  track  two  pooc  static  ntao  sf  93  socoads  sack* 
CkroaolSgicsllT.  the  trackiag  tasks  wsro  prsseatad  ia  tho  foUowiag  sagesaca: 


kiitm 


L3U 


Tho  subjoct s ears  trsiaod  until  tks  porformaacs  scorss  skoued  sayaptotic 
bohavior  (dofinad  9%  loss  thnn  52  ckango  in  tka  moan  aguaro  orror  for  tkreo 
comsocucivo  ropllcatioaa)  and  site  aack  subjoct  moist slnod  sdoguats  tolsrsacs 
to  tho  stross  levol.  This  toiorancs  ess  dotsrmlsod  through  tho  subjoct*#  sad 
eedlcsl  monitor*#  evslustion  as  to  hia  adaptation  to  tho  G atross  lovel  as  wall 
as  observing  the  mean  aguare  perfocmanca  scorae  during  the  streee  pheee  ef  the 
experiment*  la  table  I.  during  phaee  1.  streee  I end  Z were  the  open  loen  type 
St rose  described  previously.  In  phese  II  th«  stress  I end  2 were, 
reepoccivoly.  one  level  of  the  lew  Gy  value  end  e eoco;  * level  of  the  high  Gy 
value*  The  orders  of  presenrscion  of  the  Cy  levels  wore  eltemeted  from  trial 
CO  trial*  A deocrlption  of  tho  performance  aspects  of  this  experlmsat  Is 
present sd  next. 

Perforr^nce  Annlv^ie  o^  The  y : 

^ In  the  nnelysri#  \%t  ^ta  n '<An«aachlne  experiment,  manv  methods  exist 
for  assess ine  the  l*H*p  mcklnn  performance.  With  rsferencs  to  figures 

(la^b).  it  is  dovircd  to  ch.incteri»e  me^»ures  of  the  tracking  error  which  can 
he  CO  dolinc.iCv  pwriort^uivo  ch*%nges  with  or  wich.^nc  stress.  The  two 

com.'aon  OithtHls  nro  an  Scuar^)  ^\\n  Sct^^re  defined  ns  followii 

(7): 
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where  S Is  the  munher  of  <anpU‘N  et  ttnc  loncancs  Score 

cergec  c.in  be  4e flood  In  Lorn:»  of  when  the  error  slgn.il  Lb  s«oIIcr  Chen  b 
window  of  s specified  site.  3v  definition: 

•Hit  Score"  Number  of  Sampler:  when  |e(tt^)|^Ki  (2) 

where  Is  the  window  site.  The  cine  on  tarcec  is  defined  by; 

Time  on  Target  - Score  * Sampling  rate  (aeconda) 

The  use  of  hit  score  ana lyslt  Is  a valuable  tool  to  aBseea  pcrforoance 
changes;  however.  It  is  Bomatleet  difficult  to  apply  this  perfomance  metric  to 
study  large  blocks  of  data  over  various  window  sizes  and  to  draw  comparisons 
between  the  different  experimental  conditions*  An  easier  wav  to  study  the 
window  problems  (and  to  relate  the  ensuing  phase  plane  analysis  to  the  window 
study)  is  through  the  use  of  a Cumulative  Distribution  Function  (CDF)*  Figures 
Oa*3b)  lllustrste  the  density  function  (assumed  to  be  normal  In  the  dlagran) 
and  Its  corresponding  Cumuistlve  Distribution  Function  (the  first  integral  of 
the  density  function  ) defined  as  foiloirs: 


Density  Function  • f(x)  • l/'^Te  a e 

bution  Function:  • J l(s)  dt  (5a) 

• otr  ( «-u/o) 


Comulatlse  Distribution  Function: 


de 


<3b) 
(5e) 

Wh«r«  ch«  dcfinltloa  of  CKF  tn  oquocloB  (Sc)  to  nprotcatod  b*  oquodon  (3b)> 
For  o rondo*  vorloblo  x,  cho  COF  hoo  cbo  property  chot: 


r««) 


1*"  *0} 


(6) 


That  Is.  the  probability  that  the  error  signal  Is  smaller  than  a window  of 
sisa  is  equal  to  the  value  of  the  CDF  function  for  that  valua  of  To 

ii^u» crate  the  aoplicabillty  of  this  approach  for  daweloping  a better 
undarstaoding  of  the  performance  aspects  in  man^^mmchlne  systems,  use  esn  be 
made  of  the  CDF  to  compare  two  trackers  and  two  different  control  systems 
(figures  Aa-Ab). 

In  figure  (Aa).  it  is  noted  that  the  COF  (12,13)  for  a good  tracker  (one 
trial)  is  to  the  left  of  a poor  tracker.  This  Is  true  because  the  good  tracker 
keeps  all  values  of  the  error  signal  within  a window  of  alia  Ky  while  the  poor 
tracker  must  have  a window  of  slsa  K2  to  contain  all  the  samples  of  the  error 
signal.  To  interpret  window  anaiyslt  from  figure  (Aa),  this  Is  simplified  by 
using  the  horltontal  Up  is  et  a fraction  of  the  COF  value.  For  example,  for 
CDF*. 5,  Lt  is  noted  that  Che  good  tracker  keeps  SOS  of  the  error  within  a 
window  of  size  K3;  however,  cho  poor  tracker  keeps  5vS  of  the  error  within  a 
window  of  site  A oeasure  of  comparison  between  the  trackers  is  chu  dlsCAnce 
^4*^3  which  indicates  how  enich  of  s window  diffarenco  exists  between  these 
trackers  SOS  of  tho  tint.  This  analysis  Is  than  rapaatad  for  COF*0.8  and  from 
Che  CDF  plots,  Che  window  of  size  Illustrates  the  window  difference  for 

80S  of  the  error  in  the  experiment. 

The  CDF  is  a valuable  tool  to  esaast  aircraft  perfomance  as  can  be  seen 
In  figure  (^b>.  In  this  dlngrnn  the  shaded  region  A Indicates  the  range  of 
values  that  a conctol  system  nay  tuive  an  influence  on  the  clos<^d  loop 
periorn.tnce  - The  .egton  A is  shadeu  bacaase  It  is  assusMd  that  some  parnmeCer 
of  the  control  svs“c«  is  varied  over  .1  range  of  values  to  change  the  closed 
loo?  j'ortornanre.  The  left  <ide  of  tho  shaded  region  is  the  best  case  do*»inn, 
Lhv  ri^'hr  side  of  rhe  shaded  ro>;lon  is  the  vortL  cA-c  design.  Control  sv<ti  ^ 8 
vllu.rrat^wd  hv  ti'o  shaded  ifea  3.  Thts  area  B is  to  the  right  of  tho  •luid.-d 
n ion  far  Chi'  .‘ont  r'>l  whirh  fi>I  I. f * o»:3  ctu*  same  aicurent  ide  in 

X\  .*1-1'  itO.  ;hi-  U'fl  AUvi  ri:ht  hand  »*ides  of  A Indlcair,  rcnpcct  i 'O I v , 

t*;e  au,!  wriHi  ,•  »..c  dcAip.n  **'r  "*ystcm  U.  ihc  real  appUcabtil?.*  *.f 

^04 


c 

P;-U 


^ VS 


QUfti-vrt 


fiCHCc  (Ab)  i.:)  in  th«  co«r^trltoii«  butwfMsn  systoiis  hy  project  inn  linos  .it 
sncclficil  value:*  of  the  CUK  timctlon*  For  oxxiMplo,  project ln«*  the  0*^  OF 
hori/untal  line  Across  the  dliftrao,  one  con  doconiine  tho  rnn|*c  of  window 
values  whoro  each  systen  Is  effected.  From  figure  (4b) » It  is  scon  that  control 
system  A will  .lAvo  30X  error  vorlations  with  window  rondos  K|  to  K2*  Control 
systco  a,  ho%*evor»  has  window  ronf(es  froo  IC3  to  K4,  50%  of  the  tioo.  The  sioplo 
vlsnal  presonti»t  ion  in  flguro  (4b)  provides  s valuable  oothod  for  ovolusting 
systca  performance  when  non* linoorl ties  are  present  in  systens  and  comparisons 
sre  deslrsd  betwoett  the  tine  doaoin  response  characteristics  of  those  systems* 
Flnure  (3)  llluscrstes  how  to  it 11^  1 the  powerful  techniques  of  the  COF  to 
determine  quite  explicitly  how  the  effects  of  stress  on  hcnaii  trscklng 
pe.forasncs  can  be  qusntified*  In  figure  (S),  the  aeeumpcinn  la  esc*  thet  e 
closed  loop  error  pheee  plane  te  sufficient  to  describe  humen  tracking 
performance  in  this  type  of  trecking  cask*  It  is  assumed  htr^.  ^liet  along  the 
e(i)  or  e(c)  axis»  chat  there  exists  unknown  density  functions  to  describe  Che 
boundaries  along  the  two  axis*  The  median  value  of  the  density  function  is  the 
unknown  boundary  point  and  this  psramster  as  well  as  the  variance  of  this 
density  function^  will  be  determined  from  the  empirical  data*  From  figv,re  (5) 
it  is  seen  Chet  4 unknown  peremeters  exlac  which  characterise  the  dens it lee  la 
Che  following  manner;  t / « 

f.U)  - *'\/r  * * i *-<»-i‘i)*/2ai2  (7) 

where  for  no  screes  (W,l)  and  the  four  unknowns  tf i»  o sre  to  be 
deteralned  * For  the  straesed  coadition,  (1*1 ,3)  and  the  unknowna  ^ it  ^ 1 
will  also  hava  to  ba  dacarmined*  la  ordar  to  maka  oxplicic  statemaate  about 
perfocmaaca  chaagas.  It  will  ba  nacasaary  to  first  datemiae  tha  paramacars* 


^ 1»  ^1^  1*1  »4.  Oaca  thasa  unknowns  hava  baea  obtainadv  than  tha  conclueioiia 

about  Che  performance  saalyeie  cen  be  seated*  It  la  important  at  this  point  to 
understand  what  underlying  eetumptloaa  ere  necessary  to  sake  an  axpliclt 
stateaenc  about  parformance  changae* 

One  could » concelvely,  raise  the  queetloa  concaming  tha  aaaumpcioa  that  tha 
danelclee  fi<x)  sre  normal*  If  they  ere  not  aormel,  the  CDF  cable  teats  can 
still  be  used  to  establish  stacleticelly  sigaif leant  parformamea  changae* 
However,  there  still  would  exist  the  uneertainty  as  to  how  the  bouadariee  la 
flgura  (3)  ara  characterised*  The  purpooe  of  this  peper  ie  two  fold*  First  it 
is  desired  to  study  the  essumption  of  notmellty  from  tho  empirical  data  for 
this  compXsx  C flald  experlmsnt*  Secondly,  it  ie  desired  to  aeke  explicit 
scsteoencs  on  the  effect  of  the  G etreee  on  producing  e degrsdetion  In  tracking 
performance*  In  order  to  echieve  the  second  goal,  one  auet  ba  careful  to 
examine  the  underlying  denaitlee*  The  method  considered  here  involves  the 
Kolomogorov^Smlmov  test  on  the  density  functions  to  study  the  normality 
question* 


Ths  Kolooaorov> Smirnov  Tsst  To  Studv  The  Oensitiss; 

The  KolmosorovSmlmov  Test  Is  discussed  here  in  an  effort  to  make  tome 
scacenonts  about  the  underlying  deneitlee  chat  characterise  the  phase  plane 
boMfidarles  in  figure  (5)*  The  test  can  be  defined  ee  follows: 

Def iaition*7he  K-S  T<sc:  ^ 

Given  samplss  of  data  from  F^lx)  a Citrmlacive  Oistrlbucion  Function  of  the 
error  signal  (derived  from  the  empirical  samples)  end  F(  ^ ) where: 

r(ff.  - I/^W  (8) 

Fron' equation  (9).  F(  ^ ) Is  ths  theorstical  or  assumed  COF  based  on  the 

s.'.nplc  esclrvttv>  ^ and  ^ from  tho  data*  The  purpoiie  of  this  test  Is  to 
cpnsii!-""  two  liypothvsls: 

Ht>:  C(x)  If  normal 

HI:  f(x)  Is  not  normal 

It  I**  dasfrod  to  .<cc''pt  ,ir  a dosirrd  lovcl  of  st,^lflcancs  « • Thu  luvel 

- 1 f ti'inro  c lliu  risk  of  rp  lotting  the  lr*potlicsl2ad  distribution  If 

tr  *.  * *.'r  :'  c 'Tuc  • t**! ‘'t'Clon*  Tl.  ‘ c»*«r  iristlc  Is  thu 

Ic  *1  • *1  : ov**r  '*.»«»•  U'H.  T’.iu  variahlo  d Is  dofluod  AS  fo'louj; 
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d»  attx  xi  ^ >1  (9) 

It  o Is  ^pCwUtcd  at  an  .05  Ittvc)  , tiion  d tiC|K4Mls  oniv  wii  the  minhcC  of 
SAmpies  and  onn  be  docecruacd  from  tables  of  values  (8).  Ttu:  test  statistic  d 
Is  4 random  variablo  which  satisfies: 

O^d  ^ kj  (10) 

where  kj  is  from  the  table  of  values  (8)*  If  cquitlon  (10)  Is  not  s.«tisfied 
for  a specified  a.  level,  then  Ho  is  rejected.  If  (LO)  la  true,  then  the 
hypothesized  dlstrib«ition  cannot  be  rejected  and  It  can  be  said  tliet  it  is 
reasonable  to  assuae  that  the  hypothesized  distribution  is  the  true 
distribution. 

To  apply  this  test  to  the  phase  plana  analysis.  It  is  tiecessary  to  essuM 
that  Che  distribution  of  the  boundary  of  the  e(t)  axis  is  Identical  for  the 
positive  axis  as  well  as  for  the  negative  axis*  This  sysnetry  assumption  seems 
reasonable  in  light  of  the  fact  chat  the  tracking  task  Is  syemecrlcal  (zero 
mean,  constant  variance,  sun  of  sines)  and  also  the  stick  lies  sywecrlcml 
responsi.  characteristics.  Therefore  we  assume  figures  in  the  form  of  (6a«b)  In 
which  the  density  of  e(t)  is  normal.  This  same  argument  holds  for  the  e(t) 
axis. 

Results  ^roo  The  Data: 

As  e preliminary  Investigation  on  this  analysis,  consider  first  the  test  for 
I subject,  I trial,  and  2 experimental  conditions.  Figures  (7a'-l ,7a-*2) 
Illustrate  the  sample  density  j^unctlon  for  e(t)  and  e(c),  reepectivmly, 

(related  to  the  corresponding  F(x^))  from  the  data  samples  for  one  trial  In  the 
prestatic  condition.  Figures  (7h-l,7bf-2)  Is  Che  stress  counterpart  of  figures 
(7a-l,7s-2)  and  shows  the  density  obtained  under  the  stress  condition.  It 
should  be  emphasized  chat  figures  (7a*b,l*2)  all  use  the  absolute  veluea  of  the 
variables  e(c)  or  e(t)  which  link  the  hit  window  concept  with  the  phase  plane 
diagram  and  the  CDF  approach  used  here. 

Figure  (3)  displays  the  resulting  CDF's  obtained  from  the  samples  of  e(c) 
data  in 'figures  (7a*b).  One  notices  the  degradation  of  performance  level 
manifests  itself  by  shifts  to  the  right.  From  observation  of  flguree  (7a-b)  and 
(8),  one  can  now  see  how  the  two  objectives  of  this  paper  relate  to  the 
empirical  data  bate  considered  here.  First  It  is  desired  to  say  whether  figure 
(7a^b,l-^2)  can  be  approxinated  by  normal  densities.  Secondly,  from  figure  v8) 

It  Is  desired  to  say  something  about  how  much  performance  change  is  introduced 
by  the  stress  effect  . Obviously  with  one  trial,  conclusions  cannot  be  drawn* 

It  Is  neceasarv  to  . epest  this  procedure  across  repliescions  and  across 
subjects.  Flguct  (9)  Is  drawn  to  illuatrate  the  end  product  of  this  effort. 

Tlie  boundary  points  on  the  e(t)  axis  rro  ^ned  by  the  median  points  of 

figures  (7a-h)  (the  0.5  po^nc  of  the  Likewise  the  seme  procedure  Is 

repeated  for  e(t).  Tills  yiei^t  che  boundaries  of  figure  (9)  and  the  points 
obtained  are  in  Table  II: 


Table  11  ■ Medians  Obtained  From  I Triol  of  Faich  Condition 


Experimental 

Variable 

Varl.bl. 

Condition 

e(c) 

• (t) 

l^rcstatlc  1 

.660 

5715 

Stress  i 

(Phare  Il-Hlgh 

.11 

0.33 

Cv  (:<^ndlclon) 

This  studv  will  now  axLend  tiii*  cihLe  fnr  one  nubject  across  replications. 

Che  s/.nc  subject  .ts  dlspl..ved  tn  Table  ll,  the  analysis  procedure  Is  now 
ruled  CO  l-'u  ludc  -i*  to  plications  oC  the  sane  experimental  conditions.  Table 
111  IS  now  constructed  froa  choe  four  replications  of  the  phase  11  data.  The 
d.u  \ dlspl»'vcd  in  thi‘i  c.ihle  corresponds  to  that  data  used  in  final  d«ita 
a,...ly,is  la  ( 1, 15.  IS): 
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^ I |*ne^  c i^SSTi^  ^ t ftn< , 2 C xno  1^  Conti 1 1 lonsi 


[ Lv|M:r UK-niai  Cuudicion  » Variable  c(c)  I 

F»-c^Catlc  1 

Stress  1 

0*lwise  II  - nigh 
Cv  Condition)  

• 135  .015 

*43  ao 

Figure  (lOa-^h)  IXluscraCftS  the  COF*t  obtain€d  for  thm  variables  e(t)  and  i(t)  • 
To  decominc  cho  f»lanc  boundaries,  Che  0,5  line  is  projected  tiorlsonteXly 

on  figure  (LOe-b)  end  chen  projected  downward  on  the  %rindow  axis  to  dtteroiine 
Che  eedian  points*  Also  froa  this  projection,  Che  veriebility  in  this  estlaete 
•bout  Che  neen  is  obtained  by  piottlng  the  one  standard  deviation  envelope  of 

this  curve.  Figure  (il)  can  now  be  drawn*  This  represents  the  true  stress 
regions  and  non-^stress  regions  with  the  appropriate  boundaries*  The  variability 
in  Che  phase  plane  boundaries  can  be  observed  in  figure  (II)  but  they  can  also 
be  cesc«»d  using  c**cests  on  the  CDF*s  displayed  la  figures  (t0a--b)*  Tte  next 
section  will  discuss  the  tests  used* 

Scacifcical  Tests  On  The  Eeplrical  Data  base: 

The  first  goal  this  paper  is  co  study  che  oomallcy  properties  of  che 
density  functions  obtained  froe  the  eepirical  data  using  the  Koloeogorov- 
Seimov  test.  This  allows  a better  interpretation  of  the  phase  plane  boundaries 
in  figure  (5).  Using  the  data  displayed  in  table  III,  the  ■sen  CDF  is  obtained 
for  the  stressed  condition  and  the  nonstresoed  condition  for  one  subject  and  4 
replications*  To  batter  understand  the  K-S  test.  It  Is  fotnulated  hers  in  a 
statistical  fraaework* 


Problen  Foraulat ion  (Testing  Densities  For  fforaalicy); 

Consi^r  the  following  statistical  problea  with  two  alternative  hypothesis: 
Ho  : f(x)  im  ooraaX  N(  (11) 

HI  ; f(x)  is  not  ttomsl  H(9^^)  (12) 

tdiere  V • ^ are  the  sample  naan  and  standard  deviation,  respectively*  There 
are  4 elenencs  of  any  statistical  cast  for  hypothesis  testing*  The  two 
hypothesis  listed  above  are  che  first  two  elsiMnts*  The  third  element  is  the 
test  statistic;  the  fourth  element  is  the  rejection  or  critical  region*  The 
test  statistic  for  che  R-S  test  is  the  random  variable  d defined  in  equation 
(9),  It  is  noted  in  equatior  (9)  that  d is  the  naxlwim  Msitive  deviation 
between  the  two  distribution  functions  ?(?4^)  and  F(‘1^  »^)*  the  CDF  is 

the  theorccical  function  given  in  equation  (Sb)  with  the  sample  data  estinatas 
^ ^ replacing  u and  o • The  CDF  f(x^)  is  the  sanple  CDF  obtained  from  the 

accueulatlon  of  error  scores  over  a variety  of  different  window  sixes* 

The  fourth  element  of  this  test  is  che  detemlnation  of  the  rejection  or 
critical  region*  For  any  hypothesis  test,  there  exists  two  types  of  error*  A 
type  I error  is  che  rejeccior  of  Ho  when  Ho  is  cruel  Let  a donors  che 
probahillcy  of  a type  I error*  A type  11  error  is  the  acceptance  of  Ho  when  HI 
is  true*  Let  g denote  the  probability  of  a type  II  error*  Denoting  Dn  as  the 
(14,17)  critical  value  of  d such  that: 

F^d  Dn  • 1-C  (X3) 

The  expression  given  In  equation  (l3)  defines  the  rejection  or  critical  region 
an.'!  thus  provides  the  fourth  element  of  the  K*S  test*  It  Is  noted  chat  Dn  la 
found  In  tuSlcs  which  only  depend  on  M and  o and  not  on  tho  undarlylng 
.Jenrity.  Th.'  undorlylnj;  density  inpllcicly  affects  F(pj^)  and  must  he 
cpnt  inuoits  (•'^),  hut  the  K-S  test  is  only  perfortsed  on  the  dlstrlbticions 

‘V  0 . ^ ^ ) * 

The  <*v*nner  in  which  the  K*S  test  Is  applied  hero  with  respect  to  Table  III 
CO  csClr.i,.c  ?(xi)  fr.»*T  Che  neon  values  of  che  four  replications*  is 
ohLTin«'a  ir  *n  thu  ^ orajection  onto  the  OUF  curve*  To  docemine^  , the  data 
ic  ovcr\';rl  o *cr  :’»c  '•  ropMcnLl%»ns  and  a vttisfles: 


a’*- 

u 
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tur  cncli  ri:pl  Ic.icion , tin*  cwo  CDK'b  ;iro  nornpli^od  an  follows: 


Then: 

L«t  y • (Xj 

r 

a 

y , 

(15) 

c ds 

(i6«) 

F{x<,)  ■ ^ ri  / n 

oo 

(I6b) 

Where 

1 

»■* 

1 

for 

il€e) 

The  results  of  the  test  for  Table  HI  can  be  llluacraceU  as  follows: 


Table  IV  - Results  of  The  K-S  Teat  (M  » 20) 


d max 

theoretical 

d max 

theoretical 

i max 

theoretical 

d max 

empirical 

1 Frescaclc  e(c) 

.264 

.294 

.356 

.4l> 

■■■KZiBiH 

.294 

.3S6 

.442 

m—ECBBgUf«P1 

flHHESSHI 

.294 

.336 

.478 

1 Stress  1 t(t) 

i -0* 

.294 

.336 

.4j2 

In  this  cable  the  distance  variable  d refers  to  the  definition  given  In 
equation  (9).  From  the  results  of  these  tests  for  one  subject,  and  4 
replications,  we  reject  Ho  and  therefore  conclude  that  %ie  cannot  accept  the 
hypothesis  chat  the  densities  are  nomal.  it  is  noted  froa  table  V that  Che 
sattple  CDF  obtained  is  outside  the  band  which  describes  99X  of  all  sample  CDF's 
from  normal  densities.  This  is  a positive  indication  for  this  type  of  tracking 
task  that  another  type  of  density  is  required. 

Using  this  CDF  representation,  however,  allows  the  determination  of  t tests 
for  significance  of  performance  changes*  In  addition.  It  will  be  of  interest  to 
study  the  miniaum  window  sizes  where  stress  effects  appear  to  be  significant* 

As  a first  •ucss  on  the  performance  changes  bectieen  stress  and  non^stress,  an 
analysis  will  be  conducted  on  the  data  displayed  in  figures  (lOa-b).  In  both  of 
these  figures,  horizontal  lines  are  drawn  at  constant  values  of  C0F«fl  and 
projected  down  on  the  window  values  for  all  points  on  the  I envelope  of  the 
curves.  The  results  of  this  projection  are  illustrated  in  table  V: 


Table  V - Results  of  The  Horlxontal  CDF  Frojections 
( One  sub j^t  * 4 ^plications  ) 


Experimental 

CDF- 

0.2 

C0F« 

■0.4 

CDF- 

0.6 

CDF-  0.8  1 

Variable 

reap 

s.d. 

mean 

s.d. 

mean 

S.d. 

mean 

t7T. 

Static 
e(  c ) 

.023 

.004 

.0563 

.005 

.0812 

.006 

.123 

.007 

Static 

e(c) 

.103 

.010 

.206 

.012 

0.30 

.0125 

.422 

.018 

Stress 

e(c) 

.05 

.012 

.U 

.016 

0.16 

.04 

.27 

.05 

Stress 

s(t) 

.159 

.028 

.318 

.056 

.506 

.0844 

.72 

1 

.103 

To  Jetor*  iviU'  vtlues  of  miniaum  window  iLxc  where  stress  shows  effects  on 
performance,  rhe  t scatlstlc  tests  are  computed  as  follows: 

To  compare  C’\.  two  hypr.chosls : 


Tho  w-'^cecUrtc  Is  C'jtipiiLod  as  follows: 


(■  - y)  - ( « Hy-1  ) 

1 Hy 


1.  tl’. 

* 1 1*  ' 


t!o  l>  y m*;  i!.e  ouwher  af  Hc^re^•  of  f’*cC»lori 
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The  results  of  the  c ces;cs  <irc  displayed  in  Table  VI: 

T^ \ VI  - t t**scs  S»t pyptf r i cn»n ta X com?  1 1 f ons 
( One  subject  ~^7ropl ic-uio^s  ) ^ 


HB 

COKM).  4 

enr-  0.6 

CDF-  0.8 

vs 

i(t) 

A l.vel  *^.0t 
t - 1.424 

•<  level  ^005 
t-4.979 

lave  i eik  1 

fU6l3 

A li>ve  1 Da 

c-2.433 

^tacic  vs 
Stress  e(t) 

«|Qg|cg|m 

< luvu  1 

t-3.388 

t lnvel:n(K)5 
t-4.lS3 

One  can  see  fr<vB  Table  VII  that  Che  effects  of  screes  on  performance  ere  quite 
pronounced  for  one  subject  end  4 replications* 

Samery  end  Conclusions: 

A potfo nuance  study  lus  tKson  conducted  on  human  tracklns  under  e complex  C 
field*  This  paper  lllustraces  three  Importenc  points*  First  it  shows  the 
connection  between  the  phase  plane  hondary  points  end  window  measures  through 
the  use  of  a CDF  fvinctlon  on  the  data.  Secondly » the  effects  of  stress  on 
tracking  performance  manifests  Itself  via  the  t tescs  across  CDF's  under  two 
experinenCHl  conditions*  It  Is  shown  for  one  subject  end  4 replications  that 
there  exists  e significant  pu rfomance  degrachtclon  due  to  stress* 

A third  point  made  by  this  paper  is  that  a trS  test  on  the  distributions  of 
the  phase  plane  trajectories  Indicate  the  aon*nornalicy  of  the  empirical 
dsnslcy  functions*  This  statement  can  be  made  with  greater  than  99X  confidence. 
It  is  interesting  in  this  case  to  have  such  a result  hold  for  a tracking  task 
which  Is  sum  of  sines  and  to  contrast  this  result  to  the  deterministic  case 
considered  in  (7). 
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A LH1EARIZED  MODEL  FOR  VIBRATION  EFFECTS 
ON  THE  EYE  CONTBOL  SYSTEM 

RayiBond  £•  Ma^daleno 
Henry  R* 

Systestts  Technology^  Inc. 

^3^66  South  Hawthorne  Botilevard 
Havthome^  California  902^ 


In  a recent  report*  the  authors  presented  a oodel  **BIDDYN-T8”i  ^or  the 
biomechanical  effects  of  vertical  vibration  **feedthrough**  to  a pilot’s 
control  actions  and  head  bobbixig  motions.  Tbe  effects  of  the  absolute 
and  relative  laotions  of  the  head  and  display  on  the  eye's  (image)  motion 
vere  outlined  there  in  block  diagram  form,  but  the  element  dynamics  were 
not  coxBplete.  In  this  paper  ve  flesh  out  the  block  diagrams,  based  on 
a review  of  the  data  and  models  in  the  literature,  and  exercise  the  result- 
ing model  tc  illustrate  some  of  the  basic  phenomena.  Althou^  the  model 
presented  here  is  for  vertical  (heave  and  pitch)  vibration,  its  form  is 
equally  suitable  for  transverse  (sway  and  yaw  and  roll)  and  fore-aft  (surge 
and  pitch)  vibrations.  In  fact,  such  of  the  data  on  eye  response  to  head 
motions  comes  from  yaving  ejq^riments.  The  basic  assiuqption  is  that  the 
vibratory  motions  produce  small  perturbations  around  a '*triamed  operator 
posture,  so  that  the  equations  of  sensorimotor  control  can  be  linearized 
about  each  operating  condition. 

The  model  fornailation  for  vertical  eye  movements  has  been  guided  by 
work  of  Benson  and  Barnes  (l977),  Dallas  and  Jones  (1963),  and  our  inter- 
pretation of  eye  ouscj.e  dynamics  from  Robinson  (l9Tl)«  Dallas  and  Jones 
presented  some  free  .cy  response  data  for  eye  response  to  both  sine  wave 
and  random  forcing  functions,  tihe  low  variability  of  the  latter  set  Justified 
using  a proprietary  model  fitting  procedure  (MFP)  to  investigate  model 
element  forms  involved  in  the  fixation  reflex. 

The  model  is  exercised  to  reveal  qualitatively  what  happens  in  a nusiber 
of  special  cases  of  frequent  interest,  such  as:  moving  target  with  head 

fixed;  moving  head  with  target  fixed,  and  both  head  and  target  moving  (e.g., 
head  mounted  displays).  The  visual  performance  implications  of  the  model's 
image  motions  are  consistent  with  the  related  e3q>erimental  data  of  Benson 
and  Barnes  (l9?8),  on  letter  reading  perfvormance. 


*Jex«  Henry  R«,  and  Raymoixi  E.  Bfegdaleno,  "Biomechanical  Models  for 
Vibzation  Feedthrough  to  Hands  and  Head  for  a Simisupine  Pilot," 

Aviation,  Space  and  Environmental  Msdiclne,  Volume  Ho*  1,  Section  II, 
January  1978 
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DESCRIPTlON/DEMORSTKATIOIf  OF  ^*BlOimi-80” 


A Software  Package  for  Evaluating  rhe  Tranamlaslbllity  Between 
Vehicle  Vibration  and  Motions  of  Han^a  (In  \^ntroIs)» 
LlmbBr  Her \ and  Eyes 

/ 


/ Susan  A.  Riedel » Henry  R*  Jex»  and  Raymond  E«  Magdaleno 
/ Systems  Technology » Inc. 

Hawthorne*  California  90250 


ABSTRACT 

A user-oriented  program  for  exercising  the  1980  version  of  the  STI  biody* 
nanric  model  '*BI0DYN-80”  has  been  completed  under  the  sponsorship  of  the  USAF/ 
AtfRL*  BioDynamic  Branch*  The  user  inputs  (modifies)  some  80-100  variables 
describing  the  assumed  posture*  Interface  characteristics  (e.g.*  stick  "feel** 
properties)*  and  vestibular  characteristics*  Ine  computer  calculctes  the 
transfer  functions  between  vibration  input  and  various  selected  outputs  of 
Interest  to  the  user.  Another  option  is  to  output  the  operator's  torso-limb- 
neuromuscu'er  loop  transmisslbllities  as  seen  at  the  stick*  as  required  for 
the  AlfRL/BBN  **?IVIB”  computer  program  for  computing  tracking  performance 
effects  of  vibration*  Applications  to  some  current  problems  will  be  demon- 
strated* 

nmunxicnov 

BIODYN-80  is  a computerized  tool  used  to  compute  transmissibillties 
(transfer  functions)  bet%ieen  vertical  and/or  for»-  't  vibration  inputs  and 
various  biodynamic  outputs*  such  as  motions  of  the  torso*  head*  eyes*  arms  or 
hands.  The  situation  covers  a seated  pilot  gripping  an  arbitrary  angle  Stic*: 
and  viewing  a display*  possibly  engaged  in  a tracking  task*  The  physical 
model  uses  an  isomorphic*  **lump^  parameter*”  approach  to  represent  the  domi- 
nant whole-body  Joints  and  resulting  modes  of  motion*  he  software  model 
includes  a chain  of  interacting  parallel  and  serial  second-order  elements* 
with  complex  neuromuscular  and  force  feedbacks  at  the  arm  ard  head*  The 
resulting  equations  are  in  "second-order  element"  matrix  form  and  are  fairly 
general*  A separate  input  file*  which  describes  the  particuL.c  set  of  parame- 
ters to  be  used*  is  created  by  the  user  (usually  by  modifying  one  of  a cata- 
loged set).  This  file  is  incorporated  in  the  matrix  to  produce  the  linearized 
coefficients  for  perturbations  about  the  selected  equilibrium  posture 


*Thls  research  is  sponsored  by  the  Air  Forte  Aeromedical  Research 
Laboratory*  Wright-Patterson  AFB*  under  Cont.acc  F33615-79-C-0519;  the 

technical  monitor  is  Charles  Harmon* 
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Craner's  nile  Is  used  to  evaluate  the  desired  transnlsslhility  trsnster  func* 
tlons,  and  these  are  written  to  a file  In  formats  suitable  for  plotting  or  use 
In  other  programs*  Typewrlter*drawn  frequency  response  plots  (Bode  format) 
are  available  to  screen  Interesting  results* 

BIO0Y>’-f  s onj  result  of  a several  year  developnent  effort,  reported  in 
rletail  elsewhere*  ^ It  is  based  on  vibration  neasurenents  made  at  AMRL/RBV 
and  elsewhere*  Most  of  the  torso,  limb  and  stick  model  elements  have  been 
validated  by  independent  vibration  measurements  (e*g*,  Jex  and  Allen^),  and 
the  neck,  head  and  eye  effects  show  promlsyig  correlations  «rlth  the  fci: 
available  measurements  on  image  notion  effects*”  Ho%fever,  many  aspects  rensln 
ro  be  explored,  validated  or  u graded  as  more  experiments  are  run  and  liter* 
preted  via  RIODYN-BO. 

The  possible  applications  of  this  Interactive  tool  are  many*  It  should  be 
helpful  tn  the  early  stages  of  experimental  design  for  determining  the  optimal 
locations  for  vibration  omasurements  and/or  selection  of  frequencies*  It  can 
be  used  by  development  engineers  for  solving  practical  pllot-vehlc'  Interface 
design  problems  such  as  pilot-induced  oscillations  and  for  choosli.  the  beat 
among  design  alternatives  such  as  seating  location,  orientation  and  suspension 
parameters*  Flight  control  system  designers  can  make  use  of  RIODTN  output  In 
optimising  vehlcle/alrcrcw  ride  qualities  and  visual  performance  effects, 
possibly  Incorporating  antl-vlbratlon  devices  to  Improve  the  design*  These 
are  but  s few  of  the  wide  range  of  potential  applications  for  this  computer- 
ised, Interactive  model* 

One  further  application  of  RIODTN-80  deserves  special  taentlon*  Its  vlbrs- 
tlon-lnput  Co  blodynamic  parsfierer-o%itput  transfer  functions  are  Ideally 
suited  as  Input  to  PIVIB,  another  soft%tare  package  which  relates  pilot  track- 
ing performance  to  th  vibration  environment*'  Inputs  to  PlVlB  require  bio- 
mechanical transfer  functions  which  are  output  by  BIODTN-80*  The  details  of 
the  ?IonW-80/PlVIR  Interface  are  found  In  the  BIODTN-RO  user's  msnual*” 

Figure  1 provides  s functional  block  diagram  description  of  the  elements 
In  <aiki  Its  Interface  with  PIVIB,  The  reMlnder  of  this  report  details 
the  u'-e  of  BlODYN-80,  including  the  laodel  used,  the  creation  of  the  required 
input  flies,  an  example  problem  from  start  to  finish,  and  a suggested  Inter- 
pretation of  results* 

omviBv 

The  RlOOYN-80  package  Is  comprised  of  three  prog*-ams*  The  first,  called 
CREATE,  interactively  assembles  the  two  Input  flies  used  by  RIOD^*  The 
second,  called  BIODYN,  Is  the  actual  **nunber  cruncher,**  %ihlch  sets  up  anu 
solves  the  biomechanical  equations  and  conputes  the  desired  tre-afer  func- 
tions* The  third,  called  PLOT,  reads  the  file  of  RIODTN  transfer  functions, 
prints  selected  ones  in  a form  readily  comprehended  by  the  user,  and  prepares 
"quick  plot"  Bode  plots  on  the  line  printer,  to  facilitate  e visual  Interpre- 
tation of  the  transfer  function  Information*  Roth  RIODTN  and  PLOT  are  de- 
signed as  batoh  programs  while,  as  stated  above,  CREATE  Is  user-interactive* 

A subsequent  link  in  this  series  cf  programs  Is  PIVIB*  It:  Is  a large 
batch  program  with  three  gndules*  The  first,  RDftOD,  conputes  the  response 
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behavior  of  the  various  bloriechanlcal  suhsysCetas*  The  second,  PVMOD,  uses  Che 
results  of  BDtfOD  and  the  BBN  optimal  control  oodel  to  estimate  pilot  tracking 
performance  within  the  vibration  environment*  The  final  module,  VEXEC,  oro* 
vldes  the  top  level  comnunlcatlon  Interface  between  BDtIOD  and  PVtfOD,  and  per* 
forms  no  actual  computation*  It  Is  In  the  BDHOD  nodule  where  blodynamlc 
transfer  functions  must  be  specified,  and  this  Is  the  location  of  BIODYN*PIVIR 
Interface*  Further  details  may  be  found  In  the  PIVIB  user's  oianual* 

BIODY^I-60  uses  three  separate  files  in  the  process  of  performing  Its  com* 
putatlons*  The  PARAMETER  file  contains  the  set  of  96  parameters  used  to 
define  the  specific  pllot*po8ture*vibration*display  configuration*  CREATE  is 
used  to  assemble  this  file  and  can  nodify  an  existing  file  or  produce  an 
entirely  new  file*  The  CHOICES  file  contains  the  list  of  desired  transfer 
functions  to  be  computed  and  output  by  BIODYN,  as  well  as  directives  for  pro* 
duclng  the  line  printer  Rode  plots*  Again,  this  CHOICES  file  is  asseabled  by 
CREATE*  Finally,  the  TF  file  Is  used  to  store  the  resulting  transfer  func* 
tlons  output  by  BIODYN,  and  Is  read  by  the  PLOT  routine  for  generating  the 
Bode  plots* 

PIVIB  employs  a single  large  file  to  direct  its  flow  of  execution*  This 
file  defines  the  vibration  environment,  biomechanical  transfer  functions, 
tracking  dynamics,  tracking  performance  requirements,  and  pilot  limitations 
(bandwidths,  time  delays,  etc*)*  Currently,  this  file  is  assembled  in  the 
editor,  using  output  from  RIO0YN*80  If  desired* 

!II0DYN*R0  and  each  of  Its  predecessors  were  developed  on  the  Tymshare, 
Inc*,  PDP*10  computers*  BIODYN*80  has  been  adapted  to  the  CDC  6600  coiaputer 
at  UPAFR  in  order  to  increase  its  availability  to  Air  Force  users,  and  to 
Interact  with  PIVIB,  also  resident  on  the  UPAFB  CDC  cotsputer*  The  details 
presented  here  will  address  Its  use  on  the  CDC  machine* 

Figure  2 presents  a flow  chart  illustrating  the  use  of  BIODYN  and  PIVIB  in 
a given  session*  Note  that  the  flow  of  execution  can  be  used  to  solve  a 
single  problem,  by  submitting  a single  batch  request,  or  to  iterate  on  a 
design  by  submitting  a number  of  batch  requests  using  the  same  DtOICES  file 
and  slightly  altered  PARAtlETER  files* 

MODEL  DESCXIPTIOM 

Three  distinct  subsystem  models  are  Included  In  BI0DYN*80*  They  are 
described  Individually  below* 

Blonechanlcal  Model 


Figure  i (updated  from  Fig*  2 of  Ref*  3)  presents  the  biomechanical  model 
and  defines  many  of  the  necessary  parameters  that  describe  the  nominal  (or 
trln)  situation*  It  utilizes  an  **lsonorphic,”  or  llfe*like  representation,  of 
the  major  body  segments  In  their  orientations,  simplified  to  a minlmnn  number 
of  lumped  parameter  equivalents*  The  bloowchanlcal  features  include: 
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P«rfor«ttl 
Intcricti  vcljr 
vU  BlOOYN*s 
CREATE  RoutiM 
using  INTERCOM 
sysUB  (roughly 
1/4  hr  por  case) 


Batch  Job 
turnaround 
tiue  >s 
S-20  uinuttf 


Performed  inter- 
actively via 
editor  (roughly 
1/2-1  hour  per 
case) 

Batch  lob  turn- 
around tiue  is 
S-20  Minutes 


Figure  1 . BIODTN-60  Flow  Ctwrt 
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322 


oa.GJhA'u  PAGE  IS 

OF  POOa  QUAUTY 


• Seolsuplne  torso;  sliding  hip  plus  rocking  chest 
supported  on  a compliant  buttocks /seat* 

• Head  bobbing  on  an  articulated  neck  with  passive 
compliance,  or  active  neurofsiscular  system* 

• Upper  arm  and  forearm  links  plus  grip*interface  coc3-> 
pliance,  driven  by  an  active  neuromuscular  system* 

• Armrrest  restraints  (optional)* 

• Stick  **feel  system**  dynamics  from  sero  to  infinite 
stiffness,  and  any  angle  of  stick  or  grip* 

The  simplified  torso  model  was  derived  to  describe  the  dominant  motions  of 
the  head  and  arm  elements;  the  **pin  ^Int**  node  between  upper  and  lower  torso 
segments  is  not  meant  to  represent  any  physical  feature*  In  practice,  the 
masses  and  Inertias  are  obtained  from  tabulated  biooechanic^  and  anthropo* 
oetric  data  for  the  appropriate  sired  person  (e*g*,  Magdaleno^),  the  postural 
angles  are  based  on  the  actual  situation  (preferably  via  a side->view  photo), 
and  the  spring  forces  and  damping  coefficients  are  fitted  to  data  or  taken 
from  other  motions 

Limb  Neuromuscular  Model 


The  active  neuroouseular  system  noted  on  Fig*  3 is  a schematic  represents*-* 
tion  of  the  net  effect  of  complex  agonist /antagonise  muscle  pairs  controlling 
the  upper  arm  or  head*  An  **NM  switch**  is  defined  in  the  FARAHETFR  file  which 
causes  this  neuromuscular  model  to  control  the  ‘imb  (Iff  • 0)  or  the  head  (Iff  ■ 
1)«  A linearised  representation  of  the  limb  neuromuscular  model  is  shown  in 
Fig*  4,  while  the  head  neuromuscular  model  is  depicted  in  Fig*  5*  This  model 
relates  the  action  of  the  muscle  pairs  to  the  effective  (spindle)  sensors  of 
muscle  length  and  force  as  well  as  proprioceptive  senses  from  the  stick--grlp 
Interface  (in  the  case  of  the  limb  neuromuscular  model)  or  the  head^neck 
Interface  (in  the  case  of  the  head  neuromuscular  model),  to  complete  the  loop 
through  central  nervous  system  processing* 

Unless  the  neuromuscular  properties  are  feeing  investigated,  it  is  recom- 
nended  that  the  given  values  of  the  parameters”  be  used*  They  are  representa-> 
tive  of  a normal  person's  arsr-hand  or  head-neck  system,  and  generally  yield 
reasonably  damped  neuromuscular  servo  properties*  The  neurofauscular  parax> 
ters^  are  characteristic  of  the  largest  muscles  in  the  body  (‘?*g*,  the  legs) 
but  experience  has  shown  that  the  dynamic  properties  (torque /inertia  ratios, 
damping  ratios,  natural  frequencies,  etc*)  are  about  the  same  for  all  postural 
muscle  pairs*  Here,  an  empirical  scale  factor  S (>  1*0)  is  used  to  scale  the 
normalized  muscle  to  a particular  configuration,  as  though  the  muscle  acted 
normal  to  the  upper  arm  c*g*  More  detailed  description  of  the  neuromuscular 
model  is  given  elsewhere* 
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Figure  A.  Linearised  Limb  Neuromuscular  System  (When  the  Option 
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Neck/Head/Eye  ^fodel 

Figure  6 illustrates  the  basic  elements  involved  in  the  neck/head/eye 
nodel*  Details  involving  validation  and  example  use  of  this  subsysten  model 
are  found  in  Ref.  6.  The  task  is  to  keep  the  eye  fixated  on  the  target.  i«e*. 
null  the  relative  eye  (point  of  regard)  deviation  (RED)  at  the  display.  The 
novlng  base  can  produce  Image  error  disturbances,  both  from  induced  head  rota^- 
tion  and  translation  as  well  as  target  motions.  The  '*vestibulo-ocular  reflex” 
(C^Ckj)  is  a ”cro8sfeed”  (or  ••feedforward”)  that  rotates  the  eye  oppositely  to 
the  head  to  compensate  for  head  rotation,  i.e..  to  maintain  approximate  lner~ 
tial  eye  fixation. 

The  ’•Fixation  Reflex”  or  feedback  tracking  loop  (Cg(^)  involves  the  sub- 
ject's efforts  to  null  the  image  error  9^  by  compensatory  eye  novements.  The 
••Target  Pursuit”  path  (GpG^)  models  the  subject's  "feedforward”  operations  on 
the  perceived  absolute  target  notions  in  inertial  space  (as  distinct  from  the 
image  error  motions).  For  highly  predictable  aad  perceivable  target  motions 
the  Target  Pursuit  path  is  capable  of  greatly  reducing  the  image  errors. 

The  linearised  model  formulation  assumes  that  the  target  remains  within 
the  foveal  area  (3-4  deg  field),  and  that  angular  velocities  are  small  (i.e.. 
less  than  20  deg/sec)  such  that  saccades  are  rare  and  can  be  Ignored  for  most 
purposes.  Additionally,  the  vibration-induced  motions  will  always  be  small 
enough  to  permit  linearization  of  all  angular  functions  and  allow  a quasi- 
1 inear  representation  of  the  dynamic  elements  about  each  "operating  point” 
(posture,  view  geometry,  frequency). 

The  three  subsystem  models  described  above  contain  parameters  which  must 
be  assigned  values  via  the  PARAffETER  file,  in  order  to  describe  the  desired 
problem  to  BIODYN.  These  parameters  are  defined  elsewhere.’^ 

AN  EXAMPLE  PROBLEM 

This  section  presents  a typical  terminal  session  in  the  Intercom  4.7  oper- 
ating system,  accessing  the  CSA  mainframe  at  Wrlght-Patterson  AFB's  ASD  Compu- 
ter Onter.  The  dialog  is  annotated  so  that  a beginning  user  can  follow  the 
entire  job  from  start  to  finish.  All  user  responses  are  underlined. 

This  particular  session  on  the  computer  was  an  investigation  of  the  dif- 
ferences in  the  DTH/DXP  and  RHD/DXP  transfer  functions  between  a pilot  in  an 
erejt  otientation  and  a pilot  in  a senisupine  orientation.  Only  two  parame- 
t*^  r"i  are  changed:  in  the  erect  posture,  the  angle  between  the  torso-c.g.-to- 
hlps  pivot  and  vertical  is  10  deg.  %diile  in  the  senisupine  posture  the  angle 
i&  65  deg;  and  in  the  erect  posture,  the  angle  between  the  head  c.g.  and 
head /neck  pivot  is  70  deg.  while  in  the  semisupine  posture  the  angle  is  110 
deg. 


The  steps  followed  in  the  investigation  are  listed  below: 

1)  Log  in  to  Intercom. 

2)  Attach  the  PARAMETER  file  to  be  modified  and  name  it 
TAPE20. 


326 


Compensatory  Action 

(K  DE  *^RE  i)(2  - I Angular  Image  Motion  Feedbock 


ORIGINAL  t^AGc  IS 
OF  POOR  QUALITY 


327 


Figure  6.  Block  Diagram  for  Head,  Eye,  Vestibular  1-todela  and  Display  Kinematics 


n.*rr.- 12 

0^■ 


3)  Attach  the  CREATE  program » called  EXECRT. 

4)  Run  EXECRT,  make  changes  to  exist flle»  assemble 
new  CHOICES  file. 

5)  Assemble  batch  job  to  run  BIOOYN  and  PLOT^  using  the 
two  PARAMETER  files  (old  and  niodified)  and  the  new 
CHOICES  file. 

6)  Submit  batch  job  to  input  queue. 

7)  When  job  completed » list  the  output  file. 


ADDITIONS  TO  BIODTN-80 

Three  areas  of  Interest  will  be  Investigated  to  improve  and  update  the 
software  package  described  herein.  These  include: 

• Validation  of  the  head /eye/display  model.  BI0DYN-*80 
will  be  exercised  to  verify  chat  it  correctly  pre- 
dicts past  and  current  experimental  data;  in  addi- 
tion, new  experiments  will  be  suggested  and  per- 
formed for  any  remaining  validation  areas. 

• Extension  of  ciodel.  The  roll-sway  modes  of  vibra- 
tion will  be  Incorporated  in  the  BIOOYN-80  model,  so 
as  to  be  responsive  to  experimental  interest  in 
lateral-directional  vibration.  Keen  interest  in 
helmet-mounted  displays  and  helmet -noun ted  sights 
dictates  that  this  capability  also  be  fncorporated 
into  Che  model* 

• Improved  graphics  outputs.  Additional  work  in  this 
area  centers  around  constructing  stick  figure  graph- 
ics on  a CRT  to  display  node  shapes  in  a visually 
compelling  manner. 
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Typical  INTERC(X<  Tarmtnal  Seat  ion 


LOGIN 

enter  PR08LEH  MUNBCR-LBOOOIS 


enter  pAssyoRO- 


ENTER  3-DICIT  TERHIMAL  XD-000 


03/20/80  LOCOED  IN  AT  13.21*27. 
yifH  USER-ID  CK 
EOUIP/PORT  13/000 
CONHAND-  REQUEST > tape? >«FF 

CONHAND-  REQUEST* TAPES >«Pr 

COHNANO-  ATTACH»TAPE2O»0>1P 

PF  CYCLE  NO*  « 001 
CDHrtAND-  ATTACHfCXEfRT 

PFN  IS 
eXECRT 

PF  CyCLE  NO.  - 001 
COHHAND-  EXeCRT 

NEH  file  ^ 

H2, 

LISTING  DESIRED? 

YE 

(LO)NO  OR  <SH)ORT  LISTING? 

LI 

(LO)NO  OR  (SH)ORT  LISTING? 

LO 


1*  Log  in. 

2«  Attach  files. 

3.  Attach  EXECKT  to  run  CBEATE. 
A.  Run  EXECRT* 


Get  a liating  of  file  to  be 
nodified.  If  reaponae  ia  not 
recognised,  query  repeats. 


Session  continues 
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C' . 
Of-  Qi  ,L(TY 

Continuing 


STIFF  3TH.K 


Arte  TER  rtEFINITION 

mnemonic 

UNITS 

VALUE 

LOWER  BOD^  rtASS 

XMB 

KG 

14.0000 

L.  BODY  SCAT  CUSHION  DANi^CR 

BB 

N/M/S 

1290.10 

L.  BODY  SEAT  CUSHION  STIFFNESS 

XKB 

N/M 

2938S.0 

SERIES  SPRING  GRAD. 'LOWER  BODY 

CKl 

N/M 

Z1519.0 

SEAT  TILT  ANCLE 

THL 

DEG 

13.0000 

TRIM  VERTICAL  ACCEL. 

G 

M/S2 

9 . 80000 

TORSO  NASS 

XMT 

KG 

18.0000 

TORSO  INERTIA 

zit 

K0M2 

.600000 

TORSO  DArtPTNG 

BTB 

NM/R/3 

16.7500 

TORSO  STIFFNESS 

XKTB 

NM/R 

300.000 

ANGLE  OF  XLT  FROM  VERTICAL 

THT 

DEG 

10.0000 

TORSO  CG  TO  MIPS  PIVOT  LENGTH 

aLT 

M 

. 1 30000 

ANGLE  OF  XLTN 

THTN 

DEO 

3.00000 

TOR^O  CG  TO  NECK/TORSO  PIVOT 

XLTN 

M 

. 300000 

ANCLE  OF  XLS 

THS 

DEG 

3 « 00000 

TO';SO  CG  TO  SHOULDER  LENGTH 

XLS 

M 

. 300000 

NECK  NASS 

XMN 

KG 

0. 

NECK  INERTIA 

ZIN 

KGM2 

0. 

neck/torso  DAHPER 

BNT 

NH/R/S 

. 230000 

NECK/ TORSO  STIFFNESS 

XKNT 

NM/R 

30.0000 

ANGLE  OF  XLN 

THN 

DEG 

-20.0000 

NECK  LENGTH 

XLN 

M 

.100000 

NECK  CG  TO  NECK/TORSO  PIVOT 

XLNl 

M 

.300000C-01 

HEAD  NASS 

XMH 

KG 

4.340Q0 

HEAD  INERTIA 

ZIH 

KGM2 

.390000e-0t 

HEAD/NECK  DAMPER 

BHN 

NM/R/S 

0. 

HEAD//IECK  STIFFNESS 

XKHN 

NM/R 

1 . 00000 

HEAD/NECK  COMPLIANCE 

CH 

- 

0. 

ANCLE  OF  XLH 

-1 

DEG 

70.0000 

HEAD  CG  TO  HEAD/NECK  PIVOT  LEN 

XLH 

M 

')♦ 

LINE  OF  SIGHT  ANGLE 

THV 

DEC 

-30.0000 

VIEWING  DISTANCE 

VO 

M 

. 730000 

UPPER  ARM  MASS 

XMl 

KG 

1.37200 

UPPER  ARM  INERTIA 

Z1 

KGM2 

.120000E-01 

UPPER  ARM  ANCLE 

T1 

DEG 

40.0000 

UPPER  ARM  length 

D1 

M 

. 290000 

UPPER  ARM  CG 

R1 

M/M 

. 440000 

LOWER  ARM  MASS 

XM2 

KG 

1.01700 

LOWER  ARM  INERTIA 

Z2 

KGM2 

.132C00E-01 

ELBOW  ANGLE 

TE 

DEG 

145.000 

LOWER  ARM  LENGTH 

02 

M 

.303000 

LOWER  ARM  CG 

R 

M/M 

. 300000 

GRIP  interface  ANGLF 

TIJ 

DEG 

0. 

GRIP  interface  TINE  CONSTANT 

TIF 

S 

.ioooooe-01 

GRIP  INTERFACE  COMPLIANCE 

Cl 

N/N 

. 33781 OE-04 

STICK  MASS 

XMS 

KO 

.310000 

STICK  damper 

BS 

N/M/S 

2.00000 

STICK  gradient 

XKS 

N/M 

13900.0 

STICK  COMPLIANCE  PARAMETEk 

CKS 

- 

1 . 00000 

BOBWFIGHT  SENSITIVITY  TO  NX 

SX 

N/0 

0. 

BOPWEIGMT  SENSITIVITY  TO  NZ 

SZ 

N/G 

0. 

STICK  ANGLE 

THC 

DEC 

90.0000 

STICK  lENCTH 

XLC 

M 

.610000 

STICK  OUTPUT  SCALE  FACTOR 

XKSC 

/M 

13900.0 

ARM  REST  DAMTER  (NORMAL) 

BAR 

N/M/S 

0. 

ARM  REST  STIFFNESS  (NORMAL) 

XKAR 

N/M 

0. 

ARM  REST  DAMPER  (TANG) 

BAT 

N/M/S 

0. 

ARM  REST  STIFFNESS  (TANG) 

XKAT 

M/M 

0. 

ELBOW  TO  ARM  REST  DISTANCE 

XLER 

M 

0. 

FRAC  ARM  weight  ON  ARM  REST 

ARMR 

- 

0. 

SWITCH  FOR  central  AND  F A.D. 

NM 

- 

0. 

OVERALL  SF  FOR  MUSCLE  ELEMENTS 

SI 

- 

104.400 

Session  continues 
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Continuing 


H/H  ACTUATION  CAIN 
N/n  ACTUATION  LAG 
N/H  ACTUATION  TINE  DELAY 
GAIN  OF  F.A.D* 

OAhPINO  IN  F.A.O. 

NATURAL  FREQUENCY  IN  F.A.D* 

TINE  DELAY  IN  F .A.D. 

HILLS  LAU  OANPER 
SPRING  IN  N/H  SYSTEH 
SERIES  ELASTIC  ELEHENT  DANPER 
SERIES  ELASTIC  ELEHENT  GRAD 
TENDON  DAMPER 
TENDON  GRADIENT 
SPINDLE  MODEL  GAIN 
SPINDLE  LEAD  TIME  CONSTANT 
SPINDLE  LAO  TIME  CONSTANT 
SPINDLE  HI  FRbO  LEAD  T.C. 

GOLGI  HOOEL  GAIN 

GOLGI  LEAD  TIME  CONSTANT 

OOLOI  HI  FREQ  LEAD  TIME  CONST 

OOLOI  LAO  TINE  CONSTANT 

FIXATION  ERROR  GAIN 

FIXATION  RATE  GAIN 

TIHE  DELAY  IN  FIXATION  LOOP 

PSEUDO  integrator  DRCAK  FREQ 

TARGET  PURSUIT  GAIN 

POSITION  GAIN  FROH  VESTS  SEN8R 

VELOCITY  GAIN  FROH  VESTS  SEN8R 

VESTIBULAR  LAO 

EOH  LAO  TIHE  CONSTANT 

eOH  LEAD  TIHE  CONSTANT 

SWITCH  FOR  EOH  FAST  HODS 

EOH  DAHPINO  RATIO 

CON  NATURAL  FREQUENCY 

INPUT  HNEHCNIC(S  CHARS)  AND 
TO  EXIT»  TYPE  XXX. 


XKIC 

N/N 

.204370E-01 

TCC 

S 

.0090POC-01 

TCS 

3 

.896880E-01 

XKAA 

N/N 

1.00000 

ZA 

- 

.800000 

HA 

R/8 

lA.OOOO 

TAA 

S 

0. 

BM 

N/H/S 

1.00000 

XKH 

N/H 

2.00000 

SC 

N/H/S 

2.43120 

XKE 

N/H 

40.0000 

ST 

N/H/8 

0#  • 

XKT 

N/H 

80.0000 

XK8P 

N/H 

S. 00000 

TSP 

8 

.909000C-01 

TPS 

8 

0. 

TSS 

S 

0. 

<0 

N/N 

.300000 

.0 

S 

.5S5SA0E-01 

TZ 

8 

0. 

TP 

3 

0. 

XKDE 

R/R 

7.07950 

XKRE 

R/R/S 

0. 

TV 

S 

.4Sooooe«oi 

ALPHA 

R/S 

.300000 

XKP 

R/K 

0. 

XKJE 

- 

.A70000 

XKVC 

- 

.100000 

TC2 

8 

.lOOOOOE^Ol 

TEH 

8 

.100000 

TLH 

8 

.125000C*01 

QC 

- 

1.00000 

ZE 

- 

.050000 

HE 

R/8 

310.230 

VALUE  FOR  EACH  CHANOE# 


HNEMONIC  HER  NOT  PCRH1S8IBLC.  PLEASE  REINP*JT. 
TH  >1100. 


IL 


UARNINO  - RECOHHCNDED  RANOC  FOR  THIS  PARAHETER  IS 
•30.0000  TO  130.000  DCO 
DO  YOU  UANT  TO  CMANOE  THE  VALUE  ^ 


TM 

XXX 


PLEASE  RE INPUT 


riTUE  IS  STIFF  STICK 
CHANGE  D IRED  ▼ 

!£. 

NEH  TITLE  I 
SEMI -SUPINE 


SnoBlon  coctinu.s 


Hodify  fll« 


Error  mosMge  if 
■noBonlc  not 
rocognlzod* 
Warning  if  valua 


Tit]  a aodifiad 


331 


ORIGrKAL  PAGE  tS 
OF  POOR  QUAurr 


Gontiiwlikg 


tisriMG  oesiRCD* 

IL 

OP  <SH>ORr  cisMMC^ 

FPPApertPS  for: 

SCM-SUPINC 
cOMCR  M)OY 


t4.OC0 

ICfO.l 

24985. 

71514. 

roRSO 

IR.OOO 

.90000 

14.750 

900.00 

43.000 

.11*000 

5.0000 

.lOOOO 

NtCh 

0. 

0- 

.25000 

90.000 

>20.000 

.toooo 

.300004-01 

HCAO/OtSPtOY  VVCV1N6 

4.J400 

.J9000F  01 

0. 

t.oooo 

uo.oo 

0. 

>30.000 

.75000 

ARM  (UPPER* 

LOWER) 

1.3220 

.12000C-Ot 

40  000 

.24000 

1.0170 

.tU200L-Ol 

143.00 

.30500 

ijRIP  ZNTEi^FACC 

0* 

.lOOOOCH)! 

.33781C-04 

STICK 

.31000 

2.0000 

13400. 

1.0090 

40.000 

.41000 

13400. 

ARM  REST 

O. 

0. 

0. 

0. 

neuromuscular  system 

0 104.4^ 

.20437C-.1 

.tO404E-0l 

.84R88S-01 

1.0000 

.80000 

14.000 

0. 

1.0000 

2.0000 

2.4312 

40.000 

9.0000 

.^o4ooe-oi 

0. 

0. 

.30000 

.3SS34C>Ol 

0. 

0. 

IfIRtiC  FtXArxCN/UCSTIMLOHXrULAR  SCRVO 

7.om 

0. 

.4SOOOC>OI 

.30000 

.47000 

.10000 

.lOOOOC-Ot 

.lOOOO 

.12900C-01 

I. 0000 

.43000 

Listing  of  Bodl*- 
flsi  fas 

13.000  0.8000 

5.0000  .30000 

o. 

.44000 

.30000 

O.  0. 

O.  o. 

o.  80.000 

O. 

314.23 


Sssslon  coatimiss 
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CMtlflKiBf 


MCI#  CNotccs  riLC  ^ 


CBOICZS  film. 


< toRim  TFS  KSiRo  nm  Rivts  « 

& 


TftMSPCR  FIffCTtOM  INPUT  : 

riRST  LIIC-RCSP0MSC  IMCMOMIC»  FIPCtM 


Ittsmctloas  for 


sccowR  Liic^orrtao  iwountiou*  s itcns  : 

KMC  oiuat  p«cv»  Liitrr 
KMC  UPPOI  Paco.  LZNIT 

KMC  UTPCa  PNMC  LZNIT  C«.  CCraULTS  TO  200.1 
KMC  LOMCa  PMMC  LZNIT  C«.  CCFNULTS  fO  -400.1 
LIST  <1.  TO  list  TAOLC*  O.  POO  HD  LISTI 


IP  HO  PLOT  BCSiaCO*  CHTCR  O.  POO  ALL  ITCM 


lalts. 

.343  cr  TCCKill  CXCOfTIOH  TIMC 
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ORIGIT'AL  PAGE  !8 
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Ccmtlmalag 


coiwMMD-  CAr<uic»r^irc7>c.^iCE.iy»9y» 


II9ITI4I.  CATAC06 

CT  I&-  1210001?  PFM«CH01CE 

cr  CY«  oot  000000*4  horo^.: 

CQUMAMO-  CAT^Oa»TArCO»SEHl»tO>.*** 

IMTTIM.  CAFALOC 

CT  tO«  LOOOOtS  PFM«SCni 

cr  cr*  ooi  'loooo^M  uoros.: 

COniMMO-  COfTOK 
.,CKCATgpS 


jjiam2aismM2iu^Z2=22M^ 


«TPUT.TArf7>TAyga.rAPgiO,JA^l^. 

njuMit  rAPita*  tatcio.  TM^r. 

*n5oi»T^. 

WtTti 


•iflifiOSkl* 


>TAygl»>. 


Cfttalof  FAiAWm  aai 

GBOIGES  fllM. 


S.  Um  EDITM  to  mmmhim  botch 
job  for  rwmlBt  llQDm  (BXBBIO) 
and  FLOT  (EXEFLT). 

Moto  tbot  IIODIV  roqpiiroo 
01150000. 


■ .SAMCtCOOlOtilOSgO 

. ,sTOBg.ao»to»»iooTw 


CT  to*  tlOOVII  Wl*00»lO 
CT  tsir*  002  00000120  UOROS.: 

••fiSL 


cooiiAoo-  MTCH.wip>topyr.^^  e.  Sobolt  botch  job. 

't)fV«AMO*  FILES 

— lOl.'«.  files— 

•TATFO  «TA^7  OlNPUT  OOUTF«JT  «TM^20 
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Korn  aod  Dmvid  L.  Klein*«n 

DepafeiMC  of  Eloccrical  Engiaeerlng  and  Co^uter  Science 
University  of  Connecticut 
Storrs»  Connecticut  06268 


an>i 


Attendant  to  the  direct  side  force  #V)  naneuver  of  a sectored  Force 
Fighter  fiPPj  the  transverse  acceleration  inposed  on  the  pilot.  This  lateral 
acceleration  (£v)»  uben  conbined  with  a positive  T>T  stress » is  a potential 
source  of  pilot  tracking  perfomance  lapairaent . a researdi  effort  to  inves- 
tigate these  perfomance  decreMnts  includes  experiaental  ss  ^11  as  analytical 
pilot  perforaance  aodellng  using  the  Optlaal  Control  Model^4Mm 


1 Introduction 


The  Vectored  Force  Fighter  (VFF)  is  characterised  by  several  new  and  uncon- 
ventional features*  specifically  Its  capi^ility  to  use  direct  side  force  (DSF) 
to  institute  a rapid  transverse  (lateral)  aaneuver  independent  of  aircraft 
attitude.  This  Moeuvering  capability  is  potentially  desirable  In  an  air-to- 
air  coabat  encounter*  as  it  greatly  Increases  the  aircraft's  aobility.  On 
the  one  hand,  the  evading  VFF  provides  peculiar  visual  cuea  chat  can  not  be 
readily  interpreted  by  the  attacker.  Alternatively,  the  attacking  VFF  can 
significantly  enhance  the  pilot's  lateral  tracking  perforaance  by  virtually 
ellainatlng  the  tlae  required  to  enter  into  a conventional  cum. 

Along  with  the  desirable  properties  of  the  DSF  aaneuver.  increased  levels 
of  lateral  acceleration  (Gy)  are  laposed  on  the  pilot.  This  unfaaillar  atreas 
environaenc.  which  may  be  auperlaposed  on  the  usual  noraal  (40^)  coaponent.  la 
an  unavoldalbe  result  of  the  vectored  force  aancuvering.  An  analyaia  of  the 
impact  (on  pilot  control  perforaance)  of  such  uncosaon  acceleration  la  the 
subject  of  this  paper. 

Empirical  research  Into  the  effecca  of  off^noraal  acceleration  stress  on 
lateral  tracking  task  performance  waa  conducted  by  Loose,  et  al  (1).  They 
found  that  It  waa  '^harder"  to  perfom  the  task  when  under  Gy  stress,  and 
sighted  a 20t  increase,  from  the  fix^d  base  condition.  In  tne  RMS  tracking 


3A0 


error  values.  Those  results  hove  eotlvsted  further  quentif  lest  ion  of  pilot 
psrfonunce  under  various  levels  of  Gy  stress,  using  tracking  scores  and  other 
perforsence  Metrics.  In  addition,  a normative  pilot  model,  capable  of  pre* 
dieting  performance  changes  as  a function  of  Gy  levels  has  become  a develop- 
mental goal.  Consequently,  a Joint  experimental/analytical  program  has  been 
undertaken  by  the  Aerospace  Medical  kesearch  Laboratory  (AMIL),  WPAFB,  and  the 
University  of  Connecticut. 

The  experimental  phase  Included  compensatory  tracking  tasks  la  the  lateral 
plane,  and  was  conducted  on  the  Dynamic  Environment  Simulator  (DES)  centrifuge. 
Of  the  various  modes  employed  in  the  experiment,  three  are  considered  in  this 
study:  (1)  Static  - fixed  base  (ST);  (2)  Dynamic  - moderate  Gy  stress  (Dl);  and 
(3)  D:^amlc  - strong  Gy  stress  (D2) . The  experimental  design  and  the  subsequent 
data  analysis  are  discussed  In  detail  in  Sections  II  and  III. 

The  ensuing  modeling  phase  resulted  in  a predictive  perfomsace  model 
based  upon  the  Optimal  Control  Model  (OCN).  The  model  has  been  modified  to 
include  the  effects  of  a closed-loop  side  force  comhined  with  a constant  G^ 
stress.  The  OCM  parameters  that  are  sensitive  to  Gy  and/or  G^  are  identified 
and  related  quantitatively  to  the  various  accelerations.  It  is  shomm  that 
the  models  developed  are  capable  of  reprodmeiag  homam  response  characteristics 
such  as  pilot  describing  functions,  control  remnant  smd  M tracking  acoraa. 
Section  IT  detaile  tha  modsllng  approach  and  rmsults. 


g«parlmental  Datail 

Tha  motion-visual  loop  used  In  tha  AMBL  axparlmants  is  given  in  Figure  1. 
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Specifics  concerning  the  lateral  axis  compensatory  tracking  task  may  be  found 
in  (?]•  The  major  addition  in  the  present  experiment  is  the  provision  for 
the  closed-Ioo^  DSF-lnduced  notion.  In  order  to  sinulate  the  lateral  accelerationt 
it  was  necessai^  to  centrifugate  the  subjects  to  a nominal  vertical  acceleration 
plateau  (G^n^Sg),  and  to  rotate  the  DES  cab  to  produce  an  off-normal  Gy  cosk 
ponent.  The  roll  coemand  input  to  the  cab.  d(t).  generated  in  conjunction  with 
the  pilot  control  signals,  is  directly  related  to  the  pointing  angle  rate.  vis*. 


sin  ^Ct) 


G (t) 
G 


zn 


G^^(t)  - 7 hit) 
yc  g p 


(1) 


The  driving  signal  and  the  plant  dynamics  were  designed  to  be  in  harmony  with 
the  DES  capabilities. 

Three  experimental  conditions  were  studied: 

(1)  ST  mode  - The  control  condition  (static)*  no  G^/Gy  acceleration  present. 

(2)  D1  mode  - Moderate  Gy  level.  In  this  condition  V*1500  ft /sec.  and 
^z*^zn*^8*  The  resulting  enseiri>le  mean  RMS  level  of  Gy^  was  .49±  *13g 
(see  Section  III). 

(3)  D2  mode  - Strong  Gy  level:  V»3000  ft/sec..  G^^G^n^^S*  resulting  Gy^ 

RMS  level  was  .76t  .llg- 

Each  session  Included  two  static  runs  followed  by  a D1  run  and  by  a D2 
run.  The  order  of  employing  the  D1/D2  modes  was  alternated  from  one  session 
to  another  in  order  to  eliminate  any  possible  Interaction  effects.  Five  sub- 
jects participated  in  a total  of  20  sessions.  With  the  removal  of  the  outliers* 
ensembles  of  37  static.  19  01*  and  19  D2  runs  resulted. 


Ill  Data  Analysis 

Of  the  numerous  time-histories  that  were  recorded  those  that  are  pertinent 
to  this  study  are  the  tracking  error ^ e(t).  the  pilot  control  input*  u(t)* 
and  the  attained  level  of  Gy*  Gy^(t).  The  data  were  tranafor««ed  to  obtain 
frequency  domain  measures  wnich  were  then  (across-subject)  ensemble-averaged 
at  the  input  frequencies.  This  procedure  yielded  the  first-  and  second-order 
statistics  of: 

a.  Pilot  describing  function.  H(j(a)  (magnitude  and  phase). 

b.  Pilot  remnant,  R(u)  . 

c.  RMS  scores  of  e(t).  u(t)  and  Gy^(t)  : ^>rms  ^spcctively' 

It  is  possible  now  to  relate  nodes  D1  and  D2  to  the  respective  attained  Gy 
levels.  From  the  FFT  analysis  we  obtain  (1)  Dl:  Gy  and  (2)  D2: 

Gy.™» 

Figure  2 illustrates  the  differecces  in  (average)  pilot  gain,  phase*  and 
remnant  for  the  three  exper'^niental  conditions.  Table  I lists  the  RMS  scores 
(±  one  standard  deviation).  Multiple  comparison  type  of  AMOVA  testa  that  have 
been  performed  on  the  reduced  data  reject  a hypothesis  of  performance  invar- 
iance among  the  three  experimental  conditions.  Significant  dlffarencea  (P<*0:>) 
exist  among  the  pilot  gains*  remnants  and  tracking  error  scores.  These  Hiffar- 
ences  occur  throughout  virtually  the  entire  frequency  range.  The  phase  exhibits 


t The  absolute  values  of  s^  and  s^  are  determined*  of  course*  by  the  driving 
noise  (w(t))  covariance.  W.  In  this  study  W*.36.  For  details  see  [2]. 
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signlf leant  dif ft ranees  only  at  the  higher  frequencies  and  no  trends  are  evl* 
dent  In  the  control  scores.  Peveral  observations  are  pertinent: 

(1)  Figure  2a  clearly  Indicates  that  Increased  levels  of  lateral  acceler- 
ation effect  reduced  pilot  gains  and  lower  control  bandvldths.  The  gain  de- 
creases by  as  auch  as  3-4  dB  between  ST  and  DI  nodes*  and  then  further  decreases 
an  additional  3-4  dB  in  the  D2  node*  This  trend  Is  likely  a consequence  of  the 
closed- loop  acceleration  stress,  as  the  subjects  tend  to  decrease  their  control 
activity  for  which  they  are  penalised  by  lateral  Jolting. 

(2)  An  indication  of  a narrower  control  bandwidth  is  also  Manifested  in 
Figure  2b,  where  increased  lag  «t  the  higher  frequencies  with  increased  Gy 
stress,  is  evident.  At  the  highest  frequency  (15.57  rad/sec),  for  exanple, 
the  phase  lag  difference  between  the  static  and  the  Dl  condition  Is  as  snich  as 
26*,  and  up  to  44* ^between  the  static  and  the  D2  condition.  In  the  modeling 
section  (IV),  we  attribute  this  lagging  tendency  not  only  to  a narrow  control 
bandwidth,  but  also  to  an  increased  hunan  reaction  tine  delay. 

It  Is  our  belief  that  the  gradual  pilot  gain  decrease  and  bandwidth 
narrowness  is  ascribed  to  Gy  stress  only,  and  that  the  nomal  acceleration 
component  has  no  effect  on  this  mode  of  human  performance.  This  has  been 
ascertained  In  a parallel  research  project  reported  In  [3];  the  control  task 
was  similar,  but  only  6^  stress  was  employed— l.e.  no  off-normal  accelerations 
were  present.  The  resulting  pilot  transfer  function  (both  gain  and  phase) 
remained  unchanged  in  both  control-  and  G^  stress  condition* • 

(3)  Increased  randomness  in  pilot  control  is  another  facet  of  the  accel- 
eration stress.  Figure  2C  Indicates  that  with  Increasing  Gy  levels  the  pilot 
control  remnant  increases.  The  amount  of  increase  Is  very  significant:  from 
the  static  condition  to  the  Dl  mode  the  Increase  Is  3.9  dB  on  the  average,  and 
from  Dl  to  D2 — an  additional  2.6  dB.  This  remnant  increase  is  attributed  to 
Gy,  as  well  as  to  G^  stress.  Based  upon  the  results  of  [2,3],  the  moderate  Gy 
level  (Dl)  does  not  affect  the  remnant  level,  as  In  both  Dl  and  the  constant 
Gz  stress  condition  [2,3]  the  remnant  levels  are  precisely  the  same.  Only 
the  higher  level  of  Gy  stress  (D2)  further  raises  the  remnant. 

(4)  Very  significant  (P<.01)  increases  in  the  BMS  tracking  error  values  In 

Dl  and  D2  are  Indicated  In  Table  I,  and  depicted  In  Figure  6.  The  Increase 
frov  the  ST  to  the  Dl  condition  Is  by  271  and  from  Dl  to  D2— by  18X.  As  In 
(3),  these  Increases  are  partly  attributed  to  the  sustained  G^  stress:  a 13Z 

Increase  in  tracking  scores  was  noted  in  the  constant  condition  in  [2,3]. 

IV  Hodellng  Results 

The  analytic  model  used  In  this  effort  is  the  OOf  [4];  the  modeling  details 
are  similar  to  those  of  [2,3].  The  parameters  in  the  OCM  that  are  descriptive  of 
human  limitations  are:  (1)  the  neuromotor  time  constant  T||,  (2)  the  lumped  time 

delay  T|),  (3)  the  motor  noise  ratio  p^,  and  (4)  the  error  and  error-rate  obser- 
vation noise  ratios  and  o^.  The  presence  of  the  subject-commanded  Gy  accelera- 
tion, which  correlates  with  the  sign^  Op  in  the  visual  loop,  requires  an  addi- 
tional parameter,  (5)  the  error  indifference  threshold  a^.  The  inclusion  of  this 
parameter  is  based  upon  the  assumption  that  e closed-loop  stress  increases  the 
Uuman's  error  indifference  threshold.  In  another  words,  the  human's  consideration 

t fteference  [3]  is  an  u^ated  version  of  [2].  It  has  been  suggested  in  [2]  that 
some  iBlnor  differences  existed  between  the  pilot  gains  in  the  static  and  the 
Gz  stress  conditions,  but  a subsequent  statistical  test  did  not  sustain  this 
assertion.  The  data  base  used  in  [3]  is  much  broader  than  In  [2],  and  these 
minor  dissimilarities  totally  diminish. 
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for  hi«  own  mll-boiiii  is  trs4sd-off  stisiwt  tbm  costrol  task,  k siallsr  sp^fosdi 
has  boon  folloMs4  in  snothsr  clossd*looy  ■pdsllng  sffort  {5]* 

In  prsctlcs*  tlis  indlffsrsocs  tiirssiioli  psrMStsr  is  tsprassstsd  im  tks  OCM 
by  Its  squirslsat  tankam  Isput  Dsscriblat  fb^tiss  [6)» 


-s  /a 


vbsrs  o Is  tbs  prsdicted  MS  trsckiog  srror*  This  fosctioo  sodifiss  tht  Bodsl 
in  too  osys  [3»4»6): 

(I)  Obssrrstion  Koiss:  Us  rsplscs  tbs  ususl  sgostioii  for  covpstiat  error 
obssrvstion  noise  with 


rp  a 

V 

• /O  I 

e e^ 


* 2 * 
- wp-  a • 
e e 


Hotice  that  the  effective  noise  ratio*  p * 
Bq-  (3). 


p‘ <» 

* •'w 

is  the  only  identifiable  psraneter  in. 


(2)  Coat  functional:  The  OQf  assueas  that  the  oell*trained  and  aotimted  ho* 

nan  operator  adopts  an  optinal  ca'*;roI  strategy*  subject  to  his  inberent  psydio-' 
physiological  linitatioos.  The  nsthenstical  interpretation  of  this  statsnent  is 
that  the  pilot*  in  the  case  at  lund*  olll  ninlnise  the  cost  functional* 


J(u) 


T 


lin 


f J [v’<*> 


♦ v^(t) 


,]«! 


(4) 


ohere  and  q^  are  the  error  and  the  control  rate  oe^ibtlngs*  Honiaally*  oe  « 
pick  4^*1*  and  adjust  q^  to  correspond  to  the  requisite  control  bandvidtii*  Tn  • 
Equation  (4)  is  applicable  in  the  absence  at  any  threshold  effects*  Uhen  the 
error  indifference  threshold  is  no  longer  negligible*  one  should  replace  the 
displayed  error  in  (4)  with  the  perceieed  one*  This  yields  a rewised  cost 
functional 

T 

J(tt)  - **(t)  ♦ dtj  . (5) 

0 


It  is  ewident  now  that  increased  a^  effects  lover  v«  luting  on  the  error*  as 
should  be  expected*  This  in  turn  results  in  higher  relative  wei|^ting  on  the 
control  rate*  and  consequently  an  increase  in  the  neuronuscular  tins  constant 

Tn- 

Figures  3*4*5  and  6f  present  the  identified  nodel  vs.  data  conparisons  for 
the  ST  (control)*  Dl*  and  D2  conditions*  Chown  are  the  pilot  describing  taac^ 
tion  nagnitudes  and  phases*  rennanta*  ant  RMS  tracking  errors  (scores).  The 

anpitical  track^ag  control  scores  (a  »s  ) are  also  conpared  with  their  nodeled 
counterparts  (a^*  a^)  in  Table  I.  ^ ” 
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FI6.  6:  NOOa  PMUNETBB  ft  SCORES  vs.  6^^^ 
(o  INOtCATCS  OPEN  LOOP  6^  ONLY)  ’ 
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.165 
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-24.3 

-16.1 

-16.5 

.234 

.257 

.274 

^>.6G0US 

a 

a 

a 

H 

ST 

.osst.ou 

.076 

.38t.l0 

mm 

Bii 

61 

.liO«±.01S 

.096 

.SSt.OP 

■P 

Bp 

D2 

.USt.022 

.110 

.3St.U 

mm 

Bai 

TABLE  I ms  SCORES  TABLE  II  NOOa  PARAMETERS 

Ite  mo49l  pmtwmtmTm  mwm  liatad  la  Tabla  II»  md  plotted  as  a foDctloo  of 
tha  MS  lavala  la  Figiira  6a-a*  It  la  claar  that  alaoat  all  tha 

paraaatara  ^aaiata  froa  tiia  static  ease*  raflactiag  a parfonaaea  dagradatloa. 
lhaaa  iacraaaaa»  hoaaaar,  caa  aot  ba  attrlbatad  to  tha  Qy  attaaa  aloaa:  tha 

austaiaad  poaitiao  accalaratioo  of  la  aa  laportaat  factor  la  this  parfor- 

aaaca  lapairBaat.  Tha  foUovlas  la  oar  propoaad  thaorp  of  hov  tha  aarlooa 
accalaratloa  coapoaaata  offset  tha  OCM  paraaatara. 

Srror  Tknthold,  a : Accordiag  to  oor  laltlal  asauaptioa.  thm 

threshold  paraaatar  la  af factad*oalp  by  tha  cloaad-loop  straaa.  Figure  6a 
ehoas  slgalficaat  lacraaaaa  la  tha  a^/o^  aaluaa  la  tha  D1  sad  D2  eoadltlooa»  sad 
it  la  claat  tiiat  tha  aubjacta  allow  for  larger  tracklag  errors  la  order  to 
aiolalsa  fbelr  Joltlog. 

HeimaRk  « r ^tm  Content^  Tha  subjacta*  taadaaey  to  Halt  their  control 
baadwldtht  under  closed»loop  lateral  accalaratloa*  la  claarly  aaalfeated  by  tiie 
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crMd  la  T||.  Flsur*  6b  aiigiMts  a aaarly  llaaar  Japtwdaaca  bataaaa  Tg  aa6 
C_  Aa  aotad  la  Eqaatloa  (5),  tha  iacraaaa  la  T|,  la  a 41racc  raaalt  of  tha 

la£caaaa  la  a,.  Iba  coaataat  (opaa-loop)  6,  atvaaa  aaa  ae  affaec  oa  thla 
paraaacar  (2,3). 

Obaanwticm  toism  Batio,  p,:  Tradlcloaallp,  poalclaa  aeealaratloa  atxaaa  (6,) 

baa  baea  recofalaad  aa  aa  aatacadaac  Co  vialoe  lapalvaaaC.  TOoaal  aialaa, 
grayouc,  aad  blur  aca  pacbapa  tha  aoat  ackaovlad^ad  ayapcoas  of  aaacalaad 
lapoaad  oo  paaalva  aiAJacCa  (a.g.  (7)).  Ihaaa  ayapCoaa,  hoaavar,  ahoald 
dlalalah  la  a coacrollad  tracklag  taak,  aa  cba  aabjaeca  parfora  atralalag 
aaaamara  to  aalatala  vlaloa.  Ha  aaaiga,  Cfaarafoca,  Cba  aoadaal  oaloa  of 
-21.4  dB  to  all  aodaa.  Ihla  p^  valaa  eorraapoada  to  •.-0.  b«t  with 
IncrMM  la  die  ladlffaranca  thrashold  aadar  GL  str«M»  ^ affawtiw  otoar^ 
vatlon  nolM  coafflciaat,  axhlbits  a slcalf leant  lacvaaaa  (Flciura  be)* 

(Xmmrvation  toiww  Ratio,  p^:  Thera  are  laalgaif leant  variations  la  P4  la  tha 

chraa  coaditloaa.  This  paraaatar  has  provu  to  ba  iaaaaaitita  to  ald^r 
or  accaleratlon  eonpooant,  ohich  la  la  agracatat  with  [2,3]  # 

Motor  Boiam  Coaffieiant,  p^^:  Thla  paraaatar  aalaly  af facta  tha  pilot  control 

reaaaat.  Aa  atatad  in  Sactloo  IIIp  aa  aacriba  tha  niant  Iacraaaa  la  thm  D1 
coadlrloo  to  G^  atraaa  only*  Alao»  aa  ahoan  la  [3]»  tha  p valiaa  la  a G, 
atraaa  altuatloa  (no  G^)  la  aa  high  aa  la  Dl.  It  la  poaalblap  tharafora»  to 
coajactura  that  low  to  nodarata  lavala  of  G^  have  no  aubataatlal  affect  on  tha 
hwaa*a  notor  nolaa.  Only  incraaaad  laoala  of  lateral  aeealaratloa  (>.5gpraa) 
affect  higher  p^*  Blghar  raaniut/p^  uadar  6,  or  0^/^  atraaa  la  a clear 
Imllcatloo  of  dacraaanta  in  notor  parfomanca.  It  haa  bean  widely  reported  that 
the  operator  paycho-notor  parfomaace  la  lapairad  under  6^  atraaa  (aog.  [8])» 
but  no  reference  to  Gy  effecta  haa  aver  bean  node. 

Tim  Dalay,  Tha  reaaoaa  for  the  Incraaaed  tlna-dalay  under  Gy  atraaa  am 
not  wall  undaratood.  The  Incraaalag  phaaa  lags  with  Incraaalng  Gy^^^t  as 
exhibited  by  the  aaplrlcal  data  In  Fl^ra  2,  clearly  ahow  tha  Incraaalng 
reaponae  lag.  Howaver»  there  la  no  aprlori  reason  to  expect  T|^  to  depend  on 
Gy.  Hhat  one  al^t  ba  seeing  la  an  Increaaa  In  tha  affective  delay  aa  position 
Ittforaation  (e)  la  degraded  relative  to  rate  (i)  Infomatlon.  A alnllar 
pbenonenon  of  increasing  reoccurs  when  a tracking  display  la  novad  into  tha 
peripheral  field. 

V Concluaiona 

An  investigation  of  the  effecta  of  a direct  aide  force  (DSF)  nanauvar  00 
pilot  cracking  perforaance  haa  been  undertaken.  The  ra»^iardi  includes 
atresa  tracking  experiannCSp  and  pilot  parfomanca  nodellng  using  the  OCn. 

It  is  suggested  that  the  hunan  operator  adnita  larger  tracking  errors , 
under  closed^loop  Gy  stress » by  incraaalng  hia  error  indifference  threshold. 
Consequently,  in  an  attenpt  to  aaeliorate  hia  lateral  acceleration,  tha  atdiject 
adopts  a control  strategy  that  lowers  hia  gain  and  constrains  hia  bandwidth. 

In  addition,  an  increased  phase  lag  in  the  pilot  transfer  functiem  is  observed, 
when  under  Gy  stress.  The  pertinent  OCM  paraaetera:  tha  indifference  thmshold, 

the  neuroaotor  tiae-conatant,  and  the  operator  tlaa-delay  all  increase,  causing 
substantial  perforaance  degradation.  We  attribute  these  paraaster  deviations  to 
Gy  stress  alone,  as  past  research  has  shown  that  open* loop  (and  constant)  6^ 
stress  had  no  effect  on  these  nodes  of  huaan  perforaance. 
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Homwr»  w wmmlm  thmt  ths  iMcxmmm  im  pilot  eootrol  rmmmt»  m oodtlod 
by  o tjmmnmmtm  iaccooM  lo  tbm  ootor  aoioo  piriitor»  is  priwrily  sscrlbsd 
to  G,  stzoss.  Bsssd  opoo  past  rssosrdit  «s  postsisto  t^t  only  ths  stroopsr 
6^  stxsss  loosls  offset  tbs  oporotor  astor  porfoxMoco*  otetoos  loo  to  aodsrsts 
lootls  boos  oo  sigolficoot  offset. 
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A oownuamum  stsifM  nooo.  rat  notion/spacc  sickness  — 

nmJMIHAKT  ttSOLTS* 

Susan  A.  Riadel 


Systems  Technology,  Inc. 
Hatfthome,  California 


ABSnUCT 

Iteceac  notion  sickness  research  literature  puts  forth  several  pronlsini; 
conceptual  theories  which  atteopt  to  **oodel**  various  portions  of  the  notion/ 
space  sickness  syndrooe.  Perhaps  the  nost  inviting  of  these  is  the  **sensory 
conflict**  theory,  advanced  hy  Reason  and  others,  which  suggests  that  the  har* 
rage  of  sensory  orientation  cues  fron  the  eyes,  vestibular  systen,  proprio* 
ceptors,  etc*,  are  interpreted  and  even  nodified  by  a central  **cociparator**  in 
the  brain,  with  respect  to  a **neural  store**  of  expected  correlations  in  noraal 
experience*  This  theory  qualitatively  explains  nsny  of  Che  observed  notion/ 
space  sickness  phenonena;  yet,  no  conprehensive  quantitative  systcn  nodel 
exists  for  researchers  to  exercise*  Such  a systen  nodel  of  fsotion/space  sick- 
ness is  needed  to:  categorize  and  order  the  ol served  facts  into  s rational 

structure;  efficiently  encode  the  Measured  data  and  dynanic  processes;  and 
reveal  key  experinents  needed  to  predict  and/or  prevent  notion  sickness  on 
earth  and  in  space* 

This  paper  reports  a prelininary  atteopt  to  satisfy  the  first  of  these 
goals*  It  presents  an  **array  of  key  facts'*  as  asseobled  fron  the  recent 
literature,  consisting  of  a collection  of  nocion/space  sickness  observations 
which  should  be  accounted  for  in  the  conpreherslve  nodel*  A oodel  structure 
which  is  responsive  to  the  **array  of  key  facts,**  as  well  as  to  the  other  re- 
qulrenents  of  a working  research  tool  (nodularity,  ease  of  use,  conciseness, 
etc*)  is  also  suggested* 

nmtoDocnoii 

The  seening  cooplexity  of  notion  sickness  in  all  of  its  asnifes tat ions  has 
kept  untold  nunbers  of  researchers  busy  for  at  least  the  past  40  years*  An 
overwhelming  aaount  of  data  has  been  collected,  observations  nade,  prelininary 
conclusions  drawn*  Research  worldwide  has  covered  a large  range  of  interest, 
using  hunan  subj«.^t$  and  anlaal  subjects,  oeasuring  physical,  psychological, 
behavioral,  and  autonomic  variables,  with  the  goal  of  discovering  causes  and 
cures  of  this  debilitating  affliction*  Even  its  most  fundamental  effect. 


*Thls  research  is  sponsored  by  the  National  Aeronautics  and  Space  Adnin- 

Istratlon  under  Contract  RAS2-10430;  the  technical  monitor  is  Melvin  Sadoff* 
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n«us««.  Is  ]MXslliut;  ss  Trslsasn^  points  out,  notion  slcknsss  spnptonstolosy 
has  no  logical  aunriaal  banaflc  in  an  avolutionary  aanaa* 

9acantly»  a thaory  haa  baan  adaancad  by  Raaaon^>  Banaon^»  and  othara  idilch 
appaara  to  tia  auch  of  tha  aotlon  alckoaaa  raaaarch  raaulto  tofiathar*  This 
ao**callad  **sanaory  conflict**  rhaory  atataa  that  various  physiological  sensors 
coabina  with  a aat  of  psychological  axpactacions*  soaatiaes  resulting  in  a 
sensory  conflict:  aotion/space  sickness*  Qoalitacivaly»  this  thaory  explains 

aany  of  the  observed  phenoMna  associated  with  notion/space  sickness*  But  the 
need  still  exists  for  a conprehensive,  dynanic  (tine  donsln)  nodal  «ihich  pre* 
diets  tha  tlae  course  of  notion  sickness  as  a function  of  the  envlronnental 
inputs  and  nadiating  or  anellorative  actions*  Such  a nodal  should: 

1)  Quantitatively  account  for  the  key  facts  of  the  notion 
sickness  syndrooe  idiich  have  been  identified  by  re- 
search to  date* 

2)  Catalcs  these  effects  in  an  orderly  and  efficient  any* 

3)  Identify  \mf  exparinents  designed  to  validate  and  test 
the  nodel  in  various  nays* 

4)  Provide  note  precise  neasures  and  nethods  for  predict- 
ing individual  susceptibility* 

5)  Suggest  treatntnts  geared  to  prevent  aotioo/spece 
sickness* 

These  are  the  objectives  of  the  nodeling  effort  described  here* 

traoni  goals  ab  rnmnoLoa 

In  order  to  acconpllsh  these  goals,  a throe-year,  three-phase  research 
effort  has  begun  at  Systens  Technology,  Inc*  The  ultioate  hope  is  to  better 
understand,  logically  organise,  and  render  predictive  the  large  aaount  of  data 
uhleh  has  arisen  out  of  the  notion/space  sickness  resear^  to  date*  To  this 
end,  the  current  research  plan  is  structured  as  follows* 

Phase  1;  Survey  and  Tentative  Model  Pevelopncnt 

Three  separate  itens  eooprise  this  phase*  The  first  is  a search  of  the 
available  literature  on  notlon/space  sickness,  concentrating  on  two  aajor 
areas:  key  facts  which  describe  notion  sickness  in  a dynaiU.c,  quantified  way; 

and  all  types  of  *>&  developed  in  the  ^t  relating  to  ootion  sickness  and 
its  peripheral  ar  - i*  Visits  to  several  key  research  facilities  are  planned 
so  that  ongoing  w..a  nay  be  Incorporated  in  the  nodel  as  well*  These  visits 
are  also  a first  step  in  establishing  open  consunlcation  lines  with  the  aotlon 
sickness  research  connunity  so  that  the  nodel  will  bacons  an  Interactive  basis 
for  the  exchange  of  Ideas  In  thlA  field* 
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The  second  work  item  will  assemble  the  results  of  the  literature  search 
into  an  "array  of  key  racts”  which  relate  to  notion  sickness  and  must  he 
accounted  for  and  predicted  by  the  conprehensive  model*  In  constructing  this 
fact  array  the  following  criteria  will  be  used: 

• Degree  of  concordance  among  investigators* 

• Degree  of  ubiquitousness  among  various  forms  of  notion 
sickness* 

• Availability  of  appropriate  quantitative  Input /output 
information* 

• Exlstance  of  a model  which  accounts  for  this  effect* 

• Interrelation  with  other  elements  In  the  fact  array* 

• Priority  of  the  effect  within  the  array. 

The  final  step  in  this  first  phase  Is  to  suggest  a tentative  raodel  struc* 
cure  which  accounts  for  the  array  of  key  facts  and  Che  interactions  aisong  the 
array  elements*  An  eclectic  policy  will  be  adopted,  such  that  the  best  and 
most  appropriate  type  of  model  will  be  Incorporated  In  each  subsystem*  Since 
many  models  already  exist  for  various  portions  of  the  comprehensive  oodel,  the 
majority  of  effort  in  this  task  will  be  establishing  the  interconnections 
among  these  several  parts* 

Phase  III  Validation,  Refinement  and  Conputerlzatlon 

Validating  Che  model  developed  In  Phase  I consists  of  obtaining  the  pre^ 
dieted  set  of  outputs  to  a given  set  of  inputs*  such  that  Che  key  facts  assesr- 
bled  In  Phase  I are  all  taken  into  account*  Validating  the  model  is  also  tied 
in  with  taodel  refinement  as  a three^cep  process:  1)  exercise  the  model  to 

natch  exlsCNig  data  or  predict  new  results;  2}  perform  experiments  to  verify 
predicted  results  or  obtain  new  results;  and  3)  update  the  model  accordlr^'ly . 
Computerization  of  the  conprehensive  model  satisfies  the  need  for  a user- 
oriented  tool  which  is  readily  available  to  the  entire  research  community*  T. 
this  end*  an  Interactive  FORTRAN  software  package  Is  envisioned  such  Chat  the 
tool  will  be  readily  usable  by  a wide  range  of  practitioners*  who  need  not  be 
familiar  with  the  detailed  mechanization*  The  Phase  II  goals  can  be  realized 
only  If  a flexible,  nodular  structure  serves  as  the  foundation  for  the  compre- 
hensive model* 

Phase  III:  Applications,  Space 

Experiments*  and  User^s  Guide 

This  phase  covers  the  maturing  stages  of  the  model  development  as  the  tool 
is  made  available  to  researchers  in  the  form  of  a User's  Guide  to  the  soft- 
ware. It  Is  anticipated  that  once  the  model  is  used  in  a variety  of  applica- 
tions* and  from  a wealth  of  different  viewpoints*  the  maturing  process  will  be 
hastened  by  new  experiments  and  a constantly  enlarging  data  base*  Particular- 
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ly  Interesting  are  potential  applications  of  the  model  in  0 % environnents 
(e*g*t  the  Space  Shuttle) • since  concerns  centering  around  preventing  S|>ace 
sickness  among  Space  Shuttle  crews  originally  motivated  this  search  for  a com- 
prehensive mot ion/ space  sickness  model* 

The  remainder  of  this  paper  presents  work  coopleted  and  ongoing  in  Phase 
I.  Areas  addressed  are  laodeling  principles,  the  array  of  key  facts,  and  a 
preliminary  model  %ihich  incorporates  some  of  the  key  facts*  It  is  clear  that 
this  model-building  effort  would  be  enormous  were  it  not  for  the  solid  ground- 
work provided  by  past  researchers*  Perhaps  the  significance  of  this  past  work 
will  become  more  apparent  when  seen  in  the  context  of  an  overall  dynamic  pro- 
cess. The  ultimate  goal  in  constructing  such  a model  is  to  provide  an  arena 
where  the  interrelationships  can  be  obsetved  and  evaluated  as  a routine  ele- 
ment in  motion  sickness  research. 

CONSlOatATIONS  III  mOELllK; 

Before  the  array  of  facts  is  assembled  from  the  modeling  vie«fpoint  it  is 
important  to  Identify  the  major  considerations  in  modeling.  There  are  two 
important  concerns  which  must  be  addressed:  the  types  of  models  %ihich  will 

form  subsections  of  the  comprehensive  model;  and  the  characteristics  essential 
to  the  proposed  model*  These  concerns  will  be  discussed  next* 

In  defining  the  types  of  models  to  incorporate  in  the  overall  model  the 
present  point  of  view  is  that  of  a systems  engineer  describing  the  inputs  and 
outputs  of  a complex  dynamic  process  — the  human  subsyatem  involved  in  motion 
sickness*  Thus,  it  is  important  to  allow  leeway  in  assembling  the  model,  such 
that  the  best  types  of  models  are  used  where  they  are  most  appropriate*  The 
model  types  include: 

• Conceptual  models*  These  are  the  most  important 
starting  points  as  they  are  a culmination  of  insight, 
mechanisms,  and  qualitative  assessments  of  interacting 
elements*  Since  such  models  are  not  quantitative, 
however,  they  are  of  limited  predictive  value  for  spe- 
cific problems* 

• Input/output  models*  The  logical  extension  of  a con- 
ceptual model  is  a numerically  exercisable  ”math” 

model  which  encodes  kno%m  data  in  a veridical  and 
efficient  way*  So-called  **input /output”  system  models 
require  knowledge  of  the  functional  relationships 
(statistical  or  signal  correlations)  of  the  system 
under  study,  although  the  detailed  internal  mechanisms 
need  not  be  specified*  Dynamic  system  models  are 
appropriate  for  several  motion  slckne«.s  subsystems, 
and  an  existing  arsenal  of  mathematical  tools  and 
system  identification  techniques  can  be  brought  to 
bear  on  the  problem*  Previous  successes  using  this 
approach  are  evident  in  the  literature *^*^ 
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• Physical  niodels*  Whenever  Che  fundament a 1 physical 

processes  of  a «lven  subsystem  are  wll  understood,  a 
detailed  physical  math  nodel  can  be  constructed*  For 
some  of  the  human  subsystems  Involved  In  motion  sick- 
ness such  models  do  Indeed  exist  (e*j^.,  semicircular 
canals  and  otoliths,  ""*^)*  Yet,  for  several  reasons, 
ocher  physical  models  which  are  desirable  for  the  com- 
prehensive nodel  may  be  a long  way  off:  mechanisms 

are  poorly  understood  and  not  readily  quantified;  the 
process  is  partly  psychological;  the  complexity  neces- 
sary to  capture  essential  details  makes  a complete 
physical  model  impractical* 

e Llvlny»  models*  In  motion  sickness  research,  much  use 
Is  made  of  animal  models  and  human  models  in  Investi- 
3atlng  environmental,  psychological,  and  drug  effects 
as  manlfes'^ed  in  motion  sickness*  When  such  models 
are  feasible,  they  lend  much  insight  into  the  motion 
sickness  syndrome  as  a whole*  This  permits  an  impor- 
tant glimpse  at  the  overall  picture,  but  often  imposes 
a problem  when  trying  to  sort  out  specific  aspects, 
symptoms,  causes,  and  effects*  In  addition,  the  use 
of  animal  models  imposes  the  problems  of  scaling  the 
effects  between  animal  and  human  and  of  experimental 
protocol  constraints* 

The  second  consideration  In  modeling  defines  the  characteristics  desirable 
for  the  proposed  comprehensive  nodel*  The  key  requirements  are  enumerated  as 
follows: 

• Modular*  It  Is  Important  to  maintain  a subsystem 
approach  to  facilitate  updates,  revisions,  and  correc- 
tions and  also  to  aid  in  computerization* 

• Dynamic  * The  tine  course  of  symptoms,  adaptation,  and 
habituation  should  be  represented* 

• Interactive*  The  nodular  interconnections  are  Impor- 
tant here  in  understanding  the  overall  motion  sickness 
picture*  And,  in  the  other  sense  of  ''interactive,” 
the  computerized  model  will  be  user-oriented  and  user- 
interactive,  both  fundamental  ingredients  for  a useful 
cool . 

s Nonlinear.  Many  Important  aspects  of  motion  sickness 
are  best  represented  by  nonlinear  elements  such  as 
thresholds,  saturations,  and  allocation  algorithms* 

• Quantitative.  Validation  of  the  model  demands  that 
key  experimental  results  be  predicted  In  ^ quantita- 
tive sense  by  exercising  the  nodel* 
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• Functionally  Isonorphlc*  Architecturally^  the  sub- 
elements  of  the  model  will  have  a functional  structure 
which  Is  an  Isomorph  with  its  hunan  counterpart*  Ihls 
allows  nodules  to  be  Identified  with  distinct  human 
elements  ( labyrinth » eyes»  neck  proprioceptors , etc*) 
even  if  a detailed  physical  model  is  not  available  for 
the  particular  element* 

• Computationally  Efficient*  A coi^prehensive  model 
which  Is  difficult • time  consunlng^  or  expensive  to 
exercise  will  find  few  users  In  the  research  labora- 
tories, no  matter  how  accurate  It  Is*  Care  must  he 
taken  In  constructing  the  software  package  and  In  pre- 
paring the  user's  guide  so  as  to  assure  Its  efficiency 
for  a wide  range  of  users* 

• Validated*  The  refinement  and  validation  of  the  model 
Is  an  ongoing  process  as  new  data  are  forthcoming,  new 
experiments  are  suggested,  and  increased  understanding 
of  interconnections  Is  gained*  The  model  structure 
T3ust  be  such  as  to  readily  acoonodate  validation  and 
subsequent  ref inement  * 

• Predictive*  It  la  essential  that  the  notion  sickness 
model  be  predictive,  so  that  its  continued  validation, 
refinement,  and  use  be  extended  to  new  situations* 

Then  It  can  serve  as  an  integral  part  of  motion  sick- 
ness technology  and  not  merely  as  a compute rlsed 
"library"  of  experimental  results* 

• Insightful*  The  ubiquitousness  of  the  motion  sickness 
syndroine  Implies  that  some  very  basic  cause-effect 
relationships  are  Involved*  It  Is  hoped  that  the  con- 
struction of  this  corap reh^. ns Ive  model  will  Illuminate 
these  basic  "motion  sickness  principles,"  which  have 
heretofore  been  unclear* 

The  types  of  models  which  may  potentially  comprise  the  comprehensive 
model,  and  the  fundamental  characteristics  to  which  the  model  must  adhere, 
have  been  discussed*  The  final  section  suggests  a start  at  encoding  some  key 
facts  In  notion  sickness  within  the  prescribed  structural  boundaries* 

NODELinC  THE  AXEAT  OP  KET  FACTS 

As  an  example  of  the  procedures  Involved  In  structuring  t comprehensive 
model,  some  of  the  key  facts  gleaned  from  a survey  of  notion  s ckness  litera- 
ture have  been  used  to  construct  a foundation  for  the  model*  An  attempt  Is 
made  to  begin  at  the  most  fundamental  levels,  defined  by  those  elements  of  the 
fact  array  which  are  most  universally  reported  and  agreed  upon.  Building  from 
this  baseline,  embellishments  and  refinements  are  made  which  account  for  more 
elements  in  the  array*  When  care  Is  taken  In  nodular  construction,  the  formu- 
lation of  this  architectural  hierarchy  fhould  progress  smoothly* 
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The  first  four  elenents  culled  from  the  fact  array  serve  as  the  baseline 
for  the  model: 


1) 


LabyrJ^*^h^ne  defective  subjects  are  immune  to  motion  sick- 

2)  itotl^^  ^^ckness  symptoms  can  be  induced  by  pure  visual  stimi** 

3)  Motijg  ll^ckness  symptoms  can  be  induced  by  pure  motion  stimu- 

4)  Motion  sickness  symptoms  can  often  be  ^^^Muatel  by  drugs, 

training,  and/cr  habituation. 


Together,  these  v/ldely~agreed-nipon  and  weii--validated  facts  specify  some 
of  the  key  components  In  the  model.  In  order  to  accommodate  each  of  the 
facts,  the  model  must  include  the  vestibular  system,  the  visual  system,  a 
neuro-chemical  system  whereon  drugs  may  act,  a ^’learning  center*’  (presumably 
in  the  central  nervous  system)  to  include  t training  and  habituation  effects  and 
a nauseogenic  system  which  actually  produces  the  taotion  sickness  symptoms. 
The  sensory  conflict  theory  discussed  briefly  in  the  Introduction  appears  to 
be  an  appropriate  conceptual  model  which  structures  Che  elements  and  their 
Interconnections  in  a global  model,  such  as  shown  in  Fig.  1. 


In  order  to  begin  validating  the  model  suggested  by  the  Fig.  1 structure, 
the  various  element  blocks  must  be  replaced  by  mathematical  tsodels  which  can 
generate  quantitative  data  for  a given  visual /met Ion  environment.  This  neces- 
sitates a return  to  the  fact  array. 


5)  Ttie  vestibular  system  is  composed  of  the  semicircular 

canals,  which  respond  to  head  angular  acceleration  and 
Indicate  head  angular  velocity,  and  the  otoliths,  which 
sense  gravity  s id  linear  acceleration  and  indicate  static 
head  orientation  with  respect  to  vertical.  • * ~ ^ 

6)  The  visual  system  senses  linear  and  angular  velocity. 

7)  The  senlcircular  canals  may  he  modeled  as  a damped  torsion 
pendulum.  *0»2j,o-26 

B)  The  otoliths  may  be  modeler^  as  linear  accelerometers  %rith 
threshold  and  neurological  adaptation.^*^^"^ 

These  facts  suggest  replacement  of  the  ’’vestibular  system”  and  ’’visual 
system”  blocks  of  Fig.  1 with  the  linearised  approximate  mathematical  models 
shown  in  Fig.  2.  As  suggested  in  the  discussion  on  modeling,  the  gl  »al  model 
is  separated  Into  a set  of  nodules,  and  Fig.  2 esents  only  the  mcdules  for 
the  visual  and  vestibular  systems.  Hote  that  the  particular  ^latheiritical 
representation'  of  the  physical  systems  shown  in  the  figure  are  only  one  exam- 
ple of  the  possible  models  which  could  be  used.  Also,  lmport..nt  details  such 
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Figure  I.  Coaprtth«a«lvt  lodttl;  Global  Structurt 
Off!  Conceptual  **Cuu  Conflict**  Model 
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M the  ¥«stitiuIo-ocalar  rtflcn  (uter^in  mommmmtm  may  ha  aaakmd  by  paraly 
vestibular  stimll)  and  the  aya  •tablllsatiM  tystw  Have  not  yet  bece  added* 


Aa  an  atampla  of  aa  evea  flaar  level  of  detail^  furtHar  bey  facta  «dilcH 
acre  carefully  explore  tKe  cue  coi^^rator  attectere  ace 


9)  Vaatlbular  alsaala  doeinate  la  the  sHort^eni  (HisH  fre** 
qeeecy)  detevelaatioa  of  acceleratioat  idaie  vleeal 
provide  loac^em  (loe  fceqeeiicy)  velocity  iaforeatioa*^^^' 


10)  UHea  veatibelar 


are  w 


IsHted  alisHqJ^; 
Loea  doBiaate*^ 


ceaflre  viaeal  ceea»  tHe  veatibelar  ceaa 
a eoaflict  occera»  veatibelar 


aeeaatioea 

P)  Croaa-coupled  or  Gbriolia  accelecatioM  emrabe  eatioe  aicb* 
aeaa  dee  to  a caeal-otolitb  coeflict*^^*^^*^ 


12)  Rapid  bead  Mvei 
poaai^^^  to 


eta  ia  ueiRlbtleaeaaae  eaeae  ■etiae  aickaeaa, 
of  otolitb  iedicatioa  of  1 g eeviroe- 


tbeae  facta  eeggeat  a ooapacator  atmetere  eaapeead  of  tee  aeparate  ale- 
oeata:  oee  ubicb  ceeparea  veatibelarly  perceived  velocity  eitb  vieeally 
perceived  velocity,  aed  aeotber  ebicb  ceeparea  aeoicircelar*ceeal*dedeced 
orieetatioa  eitb  otolitbr deduced  < ^eetatioe*  la  eadi  ceee  tbe  coeflict  cam 
ariae  froQ  t««o  aigaala  ebicb  coeflict.  or  oee  aigaal  ebicb  doao  eat  eoafini 
the  other  aigaal  (i*e*.  oee  aigaal  ia  aboeat)*  tbaa.  tbe  "ceeparator*  aot 
only  coeparea  tbe  tee  aigaala  agaiaat  oacb  other,  bet  aay  alee  coapare  each 
aigaal  agaiaat  its  *eapoctod**  va.lee.  ^ich  aay  be  depaadaat  oa  peat  experi-* 
aace.  aental  aet.  traiaiog.  etc* 

Tbe  coaparator  aadel  baa  geicbly  bacoae  quite  coaplex.  bet  aa  aa  exaaple. 
cooaider  Jest  tbe  aeaicircular  cvaal^-otolitb  eoaflict.  idiicb  aaaifeata  itself 
via  the  Coriolis  accoleratioa  aotiaa  profile*  figure  3 abeae  tbe  three  levels 
of  coapariaoa  poaaible:  diroew  ceoal^^otolitb  coaparisoa;  coopariaoa  betueen 
actual  aed  expected  caaal  aigiala;  aad  coopariaoa  betuaen  actual  and  expected 
otolitb  aigaala*  Tbe  aaaaer  la  ubicb  aigaala  are  eei^tod  ia  tbe  coapariaoa 
process  and  tbe  precise  defi%«itioa  of  "eoaflict**  have  aot  yet  beoa  iacladod  ia 
tbe  cue  roapariaoa  aodele*  la  addition,  a aiailar  aebaaetioa  of  tbia  aodole 
ebicb  coaparea  vestibular  aad  visual  cues  baa  aot  been  ahoea  ia  tbe  figure* 


(hily  a brief  ahetch  of  tbe  aetbodology  for  coaatmctiag  a co^prebeaaive 
aotion/apace  sickaeaa  oodel  baa  beoa  preoeatod*  A global  stmeture  eea  eatab* 
liabed  and  nore  detailed  apecificar*oa  of  several  coapoaeet  aodulea  eea  under* 
tahen*  Ho^b  work  reaaina.  aa  suggested  by  tbe  other  eleaenta  in  tbe  key  fact 
array*  Areas  of  interest  include  tbe  acuro-cbeaical  ayatea  and  attendant  untg 
effects,  tbe  neural  store  aa  it  la  realixed  in  babituatioe.  training,  adapts* 
tion.  etc*,  and  tbe  various  nauaeogenic  ayaptoaa  idiicb  arise  froa  very  dif* 
ferent  visual  and  notion  environaenta*  The  appendix  contains  the  full  array 
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of  m^clon/»p«c«  ftlckn«>9»  f^ctm  ^*«sft«Pihlcd  to  tht«  oolnt;  cheiie  f^ctn  ««H 
other!!  fr«n  I research  will  be  enployed  In  the  coot Inmit ion  of  this 

nodel-hiilldlo'*  effort. 


MotMT  or  nr  mtimnna  sicnsss  men 

^ole  of  the  Veotibiilor  Sy^ten 

Loberiothloe  defectleeo  0-0»)  do  oot  ootloo 
LDa  never  experience  the  tnversioo  IIImsIoo.^^ 

t.lH  exhibit  ereotcr  levels  of  A-  nnd  r.*phen«w«n4  Mee  then  nomnls,  end 
the  petteme  of  epperent  tilt  vn.  ectuel  tilt  ere  different 

'^tlon  rj>vlronnents  Ceoslne  ^Icbneee  (Cenal-Otollth  Conflict^ 

Coriolis  ecceleretlon:  cenele  provltle  erroneous  si.tnels.^ 


Direct  correletion  exists  tetween  stressor  Induced  by  Send  enveoent  end 
choir  rototlonol  veloclty.^^ 


'Iecess.^ry  nsroneters  in  predict ln5t  the  nsenltode  of  the  cross^ounled 
jine*iler  occelerotlon  disturSsnee  ore  both  the  ns^ltude  of  the  indivlduol 
sensory  cues  ond  the  ns.enitude  of  the  ^eonetric  nisastches  orient  then.^' 


Verticoi  osci notion:  nost  nouseotenic  fre^i^iency  U oround  n.2  !l».  Sick- 

ness dlnlnlshes  shove  that  snd  Is  nonexistent  shove  O.e  tlc.^ 


The  prohshiilstlc  ossunption  thst  eoch  component  in  o s*in-of-slnusolds 
verticoi  oscillotion  profile  sets  Independency,  ond  thus  their  tndivid%iel 
nouseo^nlc  effects  odd,  does  not  hold  tnie.^ 

\iihert  ond  ^kieller  effects  (C-  ond  A-nhenoneno):  loterol  tUt  %flth  no 
vlsuol  reference  lnd«ices  on  overconnensotlne  hlos  In  subjective  estlnotlon 
of  tilt  on^le  ot  lV-20  det  &-pheno»vns)  ond  on  uederconpcnsotlnc  Mos  ot 
lorter  on<tles  (A-phenooeno).^ 

the  A-  ond  K-phenoneno  ontls  estlnotlon  profiles  vorv  as  o function  of  **- 
level. 


Welthtlessness/cro-?  notion  sickness  nay  be  induced  nerely  by  novlnn  the 
Send  In  xero 

tncreOHcd  freedon  of  oovenenc  In  o yel:*htlesa  environnent  couaes  Increased 
!«tif«ceotlbt  if  tv  to  notion  slcVnesi.*^ 

*>eod  nrtwtients  ore  extent lol  to  produce  notion  tlcUness  In  xero 


SfMptow  of  wtion  «fi4  spoco  olcknoM  oro  virtually 

Croos^^ouplod  ttfinolar  occolorotton  mtiono  mtm  particularly  affactlut  la 
Inducing  aotlofi  aickaaaa  In  taro 


Return  to  noruDgravic  anvlronmtic  from  aero  9 
of  y^^^llity  and  poatural  dlaturbance,  rather  than 


la  accoopaniad  hy 


faallttga 

ilt- 


In  roller  coaster  flight  (parabolic  aanauaara)  it  is  fouad  that  aascapti* 
hllity  to  «-4xia  acceleration  changes  in  MRher  than  to  s*aaia  accelera- 
tion changes  in  eliciting  notion  siclniesa.^ 

Correlation  is  found  betuaan  nodified  tMler-habert-teat*  optehinetic 
nystacnus  asynnetrles,  and  susceptibility  to  roller  coaster  flight  sick- 
ness.^® 


Visual  ^elronnents  Causing  Sickness  (Visual-Vestibular  Confljcta) 

Visually  induced  sensation  of  notion  can  cause  synptons  of  notion  sick- 
ness.^' 

^ripheral  field  mmt  be  stinulated  in  order  to  induce  self  notion*^ 

Backg^<^nd  field  stioolation  doninatea  oeer  foreground  field  stinnla- 
tion. 

Spatial  frequency  determines  the  intensity  of  the  self-motion  illusion.^^ 

fitch  and  roll  elsually  induced  self  notion  is  strongly  dependent  on  head 
position,  suggesting  that  these  sensations  are  limited  by  otolith  cue  con- 
flict. ^ 


Sublets  experience  stronger  sensations  of  pitching  down  than  pitching 

up.^^ 

Pitch  asynnetry  is  fixed  with  respect  to  the  head,  rather  than  to  the  sub^ 
Jectiee  inpression  of  **down,**  indicating  that  its  origin  is  eisual  rather 
than  eestlbular.^^ 


Visually  induced  tilt  presents  a paradoxical  illuaion  of  continuous  body 
and  target  ooeement  combined  with  lisdted  sensed  displacement  of  both; 
this  constrains  the  apparent  induced  shift. 


Circularsection:  angular  acceleration  detection  thresholds  are  increased 
idien  acceleration  opposes  circulareection  direction,  implying  that  the 
vestibular  threshold  is  not  purely  mechanical. 


Llnearvection:  detection  t 

smaller  than  for  forwards  LV« 


l^i^sholds  for  backwards  LV  are  consistently 
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Delay  in  LV  onset  is  actrilMiteii  to  stiort  tern  (hl^H  frequency)  vestibular 
dominance  (LV  Is  cMt  coopelllnq  when  acceleration  to  constant  velocity  Is 
below  the  vestibular  threshold)*^ 

Breakdown  of  the  pursuit  reflex  and  suppression  of  the  vestibulo-ocular 
reflex  occt^  over  the  sane  frequency  region,  ioplying  a sinilarity  of 
aechanisos* 


Vestibular  G>riolis  effects  and  optoklnetically  induced  pseudo-<oriolis 
effects  cannot  be  distinguished  qualitatively*^^ 


Optokinetic  notion  sickness  synptoas  are  very  different  froci  those 
elicited  via  vestibular  stinulation*  Also,  execution  of  head  ooveaents 
decrea|^s^self*rotatioo  illusions  and  decreases  notion  sickness  inci- 
dence* * 


Coobined  Visual AHot ion  Eneironoents  Cousins  Sickness 

Vestibular  signals  doninate  in  the  short  tern  detemination  of  accelera- 
tion, while  visual  signals  provide  long*'tem  velocity  Infomatlon*^^ 


When  vestibular  cues  confim  visual  cues,  the  vestibular  cues  are  wei 
slightly;  when  a conflict  occurs,  the  vestibular  sensations  doninate* 


g|e«i 


Vestibular  stinolation  can  nodify  the  visual  evaluation  of  insge  notion*^^ 


Oculogra^c  illusion:  apparent  visual  field  ootiondue  to  otolith  stloula- 

tion*^®*^^ 


In  weightlessness,  objects  viewed  against  a dark  background  appe^  dis- 
placed while  after-insges  aove  oppositely  when  the  g^’load  is 

renoved*^^^ 


Oculogyral  lllusim:  apparent  visual  field  notion  due  to  senicircular 

canal  stinulation*^®*^ 


Drug  Effects 

Optokinetic  and  vestibular  notion  sickness  are  siullarly  affected  by  anti- 
QotloR-sickness  drugs,  inplying  a connon  pathway  for  both*^^ 

Drug  conbinations  which  act  synergistically  to  reduce  notion  sickness 
include  an  anti^holenergic  and  a synpatheninstlc*^^ 


Anti-notion-sickness  drug  effects: 
thresholds;  dininish  post-rotational 
action  is  vestibular  nucleic  synapses* 


increase  subjective  acceleration 
^|>stagnus;  aost  probable  site  of 


Drugs  successful  in  treating  notion  sickness  also  seen  to  retard  synptons 
of  dysnetric  dyslexia  and  dyspraxia*^ 
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Psychological  Factors 

Field-independent  subjects  mke  a priori  assunptlons  about  a given  notion 
environment  based  on  past  experience  and«  when  confronted  with  a new 
situation,  produce  notor  responses  tihlch  may  be  inappropriate  for  the 
environment*  Field-dependent  subjects  produce  ootor  responses  directly  In 
response  to  the  current  environment*  Field-independents  are  laore  suscep- 
tible than  field-dependents  to  notion  sickness 


FI eld- Independents  more  likely  to  experience  simulator  sickness  than 

field-dependents* 


Vestibular  thresholds  Increase  if  workload  Increases* 


58 


Vestibular  thresholds  decrease  If  subject  has  prior  knowledge  of  notion 
proflle*^^ 


Adaptation,  Habituation,  Training 


Actl 

tlon 


movenents  are  superior  to  passive  in  developing  adapta- 


Least  dlsturblng/aost  ef f Icf  vit  means  to  Coriolis  acceleration  adaptation 
is  without  visual  reference* 

32 

Adapt^tion  to  zero  g occurs  %rlthln  3-6  days  and  symptons  never  recur* 


Coriolis  accelerations  are  very  provocative  on  the  ground  and  In  transient 
weightlessness,  but  after  adaptation  to  zero  g they  are  Ineffective  In 
producing  ewtlon  sickness. 

Adaptation  to  zero  g does  not  transfer  to  seasickness**^ 


Motion  sickness  susceptibility  to  Corlolj^  stimulus  does  not  accurately 
predict  susceptibility  to  space  sickness*'^ 


Autogenic  feedback  training  Is  a compelling  and  successful  technique  for 
adaptation  to  motlon-slckness-causlng  environments* 


Miscellaneous  Facts 


Visual  cues  dominate  proprioceptive  cues  in  determining  limb  and  body 
position* 
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D/AWAJION  OF  A TFAJECICXQf  OGNWID  CONCEPT 
TOR  MANUAL  CONITOL  OF  CARRIER 
APPFOfCtJES  AND  LANDIN55 


Walter  £•  Mcileiil,  Aerospace  Engineer 
G.  Allan  Stadth,  Jr.j  Aerospace  Dogineer 
Pomid  M«  Gerdes,  Aerospace  Ihgineer  and  Pilot 

Hatior^  Aeronautics  and  Space  Adninistraticia 
Ames  Research  Center 
?feffett  Field,  CA  94035 


SUWARY 


A novel  trajectory  control  system  concept  been  inplewpnted  to  provide 
manual  control  of  a conventional  jet  aircraft.  This  concept,  called  Total  Aircraft 
Fli^t  Control  System  (TAFOOS),  utilizes  an  inverse  model  of  the  aerodynamic 
and  propulsion  characteristics  and  employs  feedforaard  control  to  provide  the 
requdj?ed  acceleration  ocnoand.  The  oonc^t  requires  on-board  digital 
conputations  ^Jhlch  can  easily  be  handled  by  a modem  airborne  cooputer. 

The  system  *«»s  studied  in  a piloted  similation  of  the  carrier  approach 
and  landing  task  with  primarily  visual  fli^t  and  g4idance  cues.  The 
principaLI  modes  of  vertical  flight-path  control  investigated  were  vertical 
velocity  conmand  and  vertical  aoceleration  conmard.  The  study  included 
itanual  carrier  approaches  with  and  without  moderate  ship  motion  and  associated 
air  disturbances,  and  tests  of  the  effects  of  discrete  gusts. 

ffanual  control  of  fli^t  path  thzou^  this  new  concept  was  shown  to  be 
feasible  as  an  addition  to  an  autcnatic  control  system  znd  to  have  potential 
as  an  ijiqaroved  mode  of  control  cf^fev  conventioral  control  for  the  carrier 
approach  task.  The  concept  edso  offers  several  advantages,  among  which  are 
design  flexibility,  autccatic  conpensation  for  external  disturbances,  and 
prevention  of  abusive  pilot  control. 


INimUCTION 

Manual  control  of  Navy  shipboard  aircraft  during  oarrier  approach^  and 
landings  is  a demanding  task  which  becomes  increasingly  difficult  as 
external  disturbances  grew  more  severe.  The  problem  of  vertical  fli^t-^th, 
or  ’‘‘neatball’^ , control  is  the  one  thact  presents  the  greatest  difficulty, 
particularly  near*  touchdown,  where  the  ship’s  air  waJee  and  deck  motion  require 
close  coordination  of  pitch  attitude  and  engine  thrust. 

T.U.S  paper  reports  the  results  of  a piloted  simulation  study  of  an 
applicaticxi  of  a novel  feedforward  trajectory  - cennand  fJi^tt  control  system 
to  the  nanual  <'arrier  approach  and  landing  task.  On  the  basis  of  previous 
flight  and  uniranned  simulation  studies  of  sxjch  systems  applied  tc  autonatic 
control,  it  appeared  that  imprevements  in  nanual  carrier  approaches  could  be 
achieved  in  terms  of  better  flight-path  control,  reduced  touchdown  scatter, 
and  reduced  pilot  worMoad. 


370 


OF  POOR  QUAs-ITY 


This  systm^  oallad  Tbtal  Aircraft  Fli^it  Control  Systn  (TAFCOS)  has 
been  in  develofsent  at  Pmes  Research  Center  for  the  past  fiw  years 
and  has  been  tested  successfully  both  in  ground-based  siaulatcrs  and  in  fli^it 
with  STOL  aircraft.  Adaptation  to  eanual  control  is  strai^tforaard  and 
provides  attractive  and  logical  adjmrt  to  an  autxxBtic  control  systoa^  as 
XAFtGS  ztas  originally  conceived.  The  advent  ix«  recent  years  of  the  airborne 
digital  cuDputer  enables  tire  basic  systra  smicture  and  the  required  additions 
to  be  pi  I I 111.  1 readily  and  inexpensively. 

In  the  present  study,  rwnual  control  through  TAFGQ6  las  applied  tc  the 
Navy  A-7E  attack  aircraft  pexfcrair^  ;trai^^->in  visual  carrier  approaches  and 
landings,  to  assess  the  feasibility  of  the  concept  for  tire  task  mid  to 
oG^are  iafrcweaents  in  fli^vt-path  control  and  landing  perfdnKnce  using 
different  vertlGal  ccHand  aodes* 


A 


9 


ST»01^ 

rou^  I i Mwli  i1  attitude  directian  cosine  ■strix 

SBOoth  rrxBi-xiiipd  attitude  directian  cosine  aatrix 

neasured  attitude  directian  cosine  aatrix 

oQManded  dr^  coefficient 

( rMHiMlerl  lift  coefficient 

niTSiMli  i!  rolling-aoBant  coefficient 

I ^r■l■l^Bilkl3  pitching  anaenr  coefficient 

coBBanded  yawing  arurnr  coefficient 

aTMniFd  thrust  coefficient 

acoeleratian  due  to  gravity 

rough  CGBBBnded  positian  vector 

SDDO^  orunded  position  vector 

measured  position  vector 

rou^  ocananded  velocity  vector 

SBDoth  cGBBBanded  veloci'ty  vector 

measured  velocity  vector 

rou^  caonanded  acceleration  vector 

smooth  ocananded  acceleration  vector 
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total  coBMnded  aoceLeration  vector 

connanded  angle  of  attack 

cQcgandec!  vertical  fli^t-path  angle 

connanded  horizontal  fli^t-path  angle 

corananded  roll  angle 

perturbation  acceleration  coBwand  vector 

perturbation  i*rust  connaixi 

perturbation  angular  acxeleration  ccBBttnd  vector 

coniaandeci  aileron  angle 

carcarvieci  stabilizer  angle 

ccxxanded  rudder  angle 

oomaanded  iduottle  angle 

sraooth  conranded  angular  velocity  vector 

Treasured  angular  velocity  vector 

smooth  connanded  angular  acceleration  vector 

total  cociTanded  angular  acceleration  vector 


ODNTROL  SYSnU  DESCRIPTION 

Syst^  featui^.  - TAFCOS  uses  a balance  of  open-loop  feedforward  control 
and  clos^-ioop  feedback  control.  The  presence  of  detailed  models  of  idie 
aircraft  force,  ixment  and  thrust  chai^teristics  in  the  feedforward  path 
enable  it  to  provide  most  of  the  control.  Feedback  is  needed  only  to 
compensate  for  external  disturbances  and  for  differences  between  the  models 
and  the  actual  airo^t.  The  basic  arrangpraent  of  these  control  loops  is 
shown  in  figure  1. 

In  TAFCGS,  pilot  input  canrands  of  aircraft  velocity,  airspeed  or 
acceleration  are  coi‘,bined,  smoothed,  and  limited  to  provide  a smooth 
executable  translationax  acceleration  coraiand  vector  in  inertial  axes.  Then 
the  system  forces  the  aircraft  to  follow  closely  this  acceleration  cciniand 
and  the  corresponding  velocity  and  position  trajectory. 

Figi^  1 shows  that  the  feedforward  path  (solid  lines)  includes  a trim 
:rap  which  is  an  inversion  of  the  aircraft  model.  This  trim  nep  iri  series 
with  the  actual  aircraft  provides  an  approxiMte  identity  (i.e.,  output 
nearly  equals  input).  The  dashed  lines  indicate  how  tfie  feedback  is  compared 
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wirh  rhR  cooRand  to  form  an  error  uhich  is  then  used  to  close  the  feed- 

back 1^*  It  should  be  noted  that  the  feedback  loop  is  closed  ahead  of 
the  trin  so  that  it  includes  the  identity;  thus  the  feedback  loop  is 
linear  and  conventional  linear  techniques  can  be  used  in  the  desi^i  of  the 
regulatcr. 

Representation  of  variables  by  three-ccnponent  vectors  and  angles  by 
their  three-by-three  direction  cosine  natrices  pcnaits  easy  transfornation  of 
quantities  betueen  different  coGrdinate  systons*  Pilot  lumhimU  are  in 
relative  velocity  axes  and  ir  ent  calculations  are  perfaraed  in  body  axes. 

System  stCTicture.-  Since  the  TAPCOS  csonoept  is  different  fpcm  conven- 
tional ffrsigns^  a brief  explaiation  of  its  structure  will  be  he]^>ful  in 
understanding  its  operation.  For  the  present  application  a nanuallvolloted 
stability  augawitation  systan  and  trajectory  ocnwsid  systm  has  been  created 
by  additicxks  to  a oonpletely  autoaatic  control  systm.  This  procedim  is  in 
contrast  to  the  usual  siaplifloation  of  an  autonatic  system  to  provide  manual 
control.  The  increase  in  complexity  is  considered  justified  bv  potential 
performance  advantages  and  by  design  flexibility.  Advances  in  airborne 
digital  cooputers  have  made  these  capabilities  possible  and  relatively 
inexpensive. 


Figure  2 is  a signal  flou  diagram  of  TAPG06,  A^in  to  emphazise  the 
op^Ioop  characterisitcs,  the  feedforuerd  paths  are  ^ham  by  solid  lines 
while  ihe  corrective  feedbacks  are  shown  by  cashed  lines.  Most  of  the 
variables  are  three-<xnponMit  vectors;  e.g.,  is  the  rou^  coamanded 
velocity  vector  in  inertial  axes  and  » is  smooth  ofanded  angular  'ccelei>- 
ation  in  body  axes.  The  three  pilot  inputs  are:  (1)  forwrd  and  aft 

movanents  of  d>e  control  stick  to  ccnnand  either  vertical  velocity  cr 
vertical  acceleration  in  inertial  axes;  (2)  left  and  ri^t  displacanent  of 
the  stick  to  conmand  rate  of  change  of  lateral  acceleration  in  velocity  axes; 
and  (3)  throttle  lever  position  to  ooraand  adrspeed.  All  roug^  comnand 
signals  are  directly  proportional  to  ttie  magnitude  of  the  control  motir^ . For 
exanple,  the  first  velocity  axis  is  directed  along  the  aircraft  veloc- 
vector  with  the  second  axis  in  the  horizontal  plane  so  that  a constant 
lateral  stick  deflection  ocwnanris  a constant  build-up  of  centripetal 
acceleration.  When  the  stick  is  returned  to  neutral,  a constant  centripetal 
acceleration  in  the  horizontal  plane  and  perpendicular  to  the  instantaneous 
velocity  vector  is  coonanded.  The  result  is  a circular  fli^  path  with  a 
constant  bank  angle. 

The  trajectory  time  sequencer  oorobines  the  various  pilot  signals  and 
calculates  a total  roug^  casB^nded  acceleration  vector  in  three-dimensional 
inertial  space.  It  also  calculates  corresponding  inertial  velocity  and 
position  vectors.  These  vector  connands  are  rou^  in  the  sense  that  they 
may  have  excessive  and  abrupt  rates  of  char>ge  and  call  for  maneuvers  trat  nay 
not  be  executable  by  tte  aircraft  within  desired  stall  margin,  canfortable 
angular  acceleration  or  attitude  limits,  or  engine  response  and  control 
surface  limits. 

~he  trajectory  comand  generator  snooths,  limits,  and  rotates  the  rou^ 
ccnrands  to  provide  an  executable  comanded-acceleraticn  vector  V-  and 
corresponding  velocity  and  position  vectors  Vg  and  lu  in  velocity  axes.  Each 
channel  of  the  trajectory  conmand  generator  includes  four  integrators  and 
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appropriate  internal  feedba(dc  Loops  so  that  a specific  dynandc  response  can 
be  provided  by  pole  placenent  or  other  linear  teciiniques.  The  rscB|)anents 
of  snooih  ooniBnied  velocity  resolved  bade  into  inertial  axes  give 
canaanded  horiaontal  and  vertical  fli^t-path  angles  and  • 

The  force  trim  nap  accepts  the  coiBMnded  specific  force  vector  and 
combines  it  with  ocrananded  dynanic  pressure  and  wing  area*  It  then  calculates 
cccinanded  total  lift  and  drag  coefficients  which  include  the  effects  of 
engii'-e  thrust.  An  inverse  interpolation  of  the  adreraft  lift  and  drag 
characteristics  stored  as  tabular  data  then  yields  the  angle  of  attadc  and 
thrust  coefficiwt  required  to  follow  the  trajectcay.  Fi®xre  3 is  a represen- 
tation of  the  force  trim  nap  data.  It  is  seen  to  be  a family  of  lift«^lrag 
polars  for  several  values  cf  Ihrust  ooefficient  . An  exanple  is  shMn  by 
the  snail  circle.  If  a lift  coefficient  of  1.2  am  a drag  ooefficient  of  aero 
are  connanded^  then  an  angle  of  attadc  of  12  degrees  and  a thrust  ooefficient 
of  0.2  would  te  the  outputs.  At  this  point  the  cannanded  input  lift  and  drag 
coefficients  are  limited  to  the  perimeter  of  the  trim  map  cr  to  a subperimeter 
to  provide  suitable  safety  margins. 

The  horisontal  and  vertical  fli^t-path  angles  and  , the  roll 

angle  angle  of  attack  aze  oonbined  in  figure  2 to  give  the 

conmanded  direction  cosine  natrix  fzem  inertial  to  boefy  axes  A^  • This 
comemded  aircraft  attitude  is  the  input  to  attitude  ooinand  generator. 

Ihe  attitude  command  generator  has  a similar  function  to  the  trajectory 
connand  generator.  It  has  two  integrators  and  appropriate  internal  feedback 
loops.  The  output  is  a smooth,  executable  connanded  axtgular  acceleration 
vector  y the  corresponding  consistent  angular  velocity  vector  , and 
the  attitude  natrix  Ag  . 

lhi\jst  coefficient  from  the  force  trim  map  is  proc^sed  by  a 
power  ^oraiand  generator  and  engine  trim  map  to  calculate  the  required  throttle 
angle  6*p  . The  power  comoand  generator  and  engine  trim  nap  pei^cra  sane 
type  of  function  as  the  trajectory  camBnd  generator  and  force  trim  nmp.  They 
provide  a smootr.  cennand  with  suitable  dynamics.  The  engine  trim  map  involves 
inverse  interpolation  of  a table  of  engine  characteristics. 

The  raoinent  trim  map  is  the  last  element  in  the  feedforward  path.  Its 
input  is  the  comanded  angular  acceleration  which  is  first  multiplied  by 
the  ainra^t  ii*ertia  natrix  to  give  the  moment  vector.  It  is  then  converted 
to  none. ' coefficients  by  corbiration  with  dynanic  pressure,  wing  area,  chord 
and  3pan.  The  moment  trim  nap  involves  a calculation  of  the  manent  already 
.xled  by  angle  of  attack,  engine  "titrust,  and  body  rates  to  detennine 
1 . much  more  moment  nust  be  si^plied  by  the  aerodynamic  control  surfaces.  An 
inverse  interpolation  of  the  aircraft  moment  data  yields  the  required  control 
surface  deflections. 

This  open-loop  control  system  is  then  supplemented  by  feedback  loops 
shown  by  the  dashed  elements  in  figure  2.  The  smooth  translational  positi^ 

rvelcx'- wy  comands  Rg  ar»d  Vs  are  compared  with  the  measured  response  R and 
and  combined  with  suitable  gains  ari  limits  in  the  trajectenry  regu^^ator 
to  gj.ve  a closed- loop  perturbation  translational  acceleration  vector  AVc 
71*^  vector  is  added  to  the  open-loop  signal  V5  to  give  the  total  signal 
as  input  to  the  force  tt'im  map.  The  gains  in  the  regulator  are  chosen  by  a 
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linear  pole-placenent  tec^mique  to  give  a satisfactGcy  dynaic  response* 

The  vector  Av^  is  gman^y  a snail  fraction  of  V and  the  feedbahck  loop  is 
essentially  linear.  Similar  techniques  are  used  to  determine  the  gadns 
in  the  attitude  regulator. 

APPLICATION  TO  CARRIER  APPROACH 

Carrier  appro^  ta^.-  Figure  4 shows  the  nomal  naraal  oarrier 
^proach  scenario.  /Tlevel  leg  is  established  first,  where  visual  line-ig> 
is  achieved  prior  to  tip-ovar.  When  the  pilot  receives  ^ proper  indication 
frcm  the  Ftesnel  Luis  Optical  landing  System  (FIOl^)  or  from  ^ SRI-41 
shipboard  tradcing  radar  cross-pointers  in  the  cockpit  he  begins  a constant- 
rate  descent  which,  for  the  present  simulation  conditions  of  airspeed  66.4 
meters/second  (129  knots),  glide  path  3.5^  with  respect  to  the  ship,  and  wind 
over  the  deck  of  15.4  meters/seccnd  (30  knots),  %es  just  over  3 meters/second 
(600  feet  per  minute).  During  the  final  descent,  guidance  is  entirely 
visual  with  vertical  fli^it  path  cues  provided  by  the  FLDLS. 

For  the  present  stud^,  the  FIDLS  display  infocvation  was  calculated  so 
that  an  orv-glid^path  ^proach  resulted  in  the  tail  hook  touching  down  mid- 
betueui  the  second  and  third  arresting  wires,  of  which  there  were  four, 
spaced  12.2  meters  (40  feet)  ^>art.  The  FLOLS  was  assumed  to  be  line 
stabilized;  i.e.,  glide  path  stabilized  agsdnst  ship  patching  motion  but  not 
agadnst  heave. 

Comtand  mo^  studied.-  The  vertical  velocity  ccmnand  (WC)  mode  and 
the  vertical  acceleration  ocrniand  (VAC)  mode  were  selected  for  study.  In 
making  this  selection,  one  line  of  thou^rrt  was  that  a given  magnitude  of 
stick  input  should  ccmnand  a given  nci£  "meatball"  rate  at  a particular 
range.  This  reasoning  led  to  WC  as  the  prime  candidate  for  the  carrier- 
approach  control  mode.  In  crder  to  de-sensitize  meatball  response  to  vertical 
fl^t  path  chang^  near  the  ship,  provision  vbs  made  for  decreasing  ooranand 
gain  wiih  decreasing  range.  Both  this  variable  and  a constant  gain  were 
investigated. 

The  terms  WC  and  VA2  apply  only  to  the  rou^  carmanded  quantities 
psroportianal  to  stick  displacement.  Smooth  oocnmnded  acceleretians  and 
velocities  are  always  generated  and  used  within  TAFCOS. 

*^t  feciLLties.-  The  study  was  conducted  using  a fixed-base  simulator 
with  a full  oonpleni^  of  flig)it  instruments  and  a set  of  hydraulically- 
loaded  fi^er/attack  aircraft  cockpit  controls.  A closed-circuit  television 
Landing  display  was  used,  oc^lete  wilh  a scale  model  aircraft  carrier  with 
heave  motion  and  a servo-driven  mechanical  representation  of  the  FIDLS  to 
display  glide-path  error.  All  simulation  calculations  were  performed  by  a 
Signa  9 general  purpose  digital  ocnputer. 

RESULTS  AND  DISCUSSION 

In  the  discussion  which  follows,  time  histories  of  control  system  and 
airplane  behcP/ior  are  presented  for  typical  simulated  str^i^t-in  carrier 
approaches.  These  approad^  include  one  using  vertical  velocity  conrand 
with  ship  motion  and  air  disturbances,  followed  by  a series  of  three  ^^ch 
show  oooparisons  between  vertical  velocity  oomnand  and  vertical  acceleration 
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comsand,  thei  cne  i±ist  sl)ous  responses  to  discrete  pist  disturtetKes.  Pilot 
CGanents  are  also  presented,  followed  by  discussions  of  naerical  pilot 
ratings  and  touchdown  perforoance  data. 

Aircraft  Response  during  Carrier  Approaches 

Ver^cal  verity  oaniand  with  slu.p  motion.-  Figure  5 shows  a tine 
history  of  a manual  carrier  approach  and  landing  with  TAFCOS  vertical 
velocity  cctnand  mode  selected.  Ship  motion  consisted  of  ^.9  meter  (+3  feet) 
of  h^ve  with  a standard  set  of  ship  air  wake  (burble)  disturbances.  For 
this  ^proach,  tip-over  was  initiated  at  about  10  seconds  after  the  start  of 
the  run.  In  order  that  the  pilot  would  not  have  to  hold  his  stick  input  to 
coanmnd  a steady  rate  of  descent  following  tip-over,  a vertiLoal  velocity 
trin  function  was  provided  using  the  pilot's  trin  button.  Thus,  the  to^ 
rou^  caimanded  vertical  velocity  was  the  sun  of  the  trin  input  (third  trace, 
fig.  5(a))  and  a signal  pi’oportional  to  the  stick  input  (second  -dnce).  The 
fifth  trace  shows  the  resulting  vertical  velocity,  which  closely  followed 
the  smooth  connund.  The  bottom  trace  shows  that  aircraft  height  foliowed 
the  (xnnonded  height  (integrated  vertic:al  velocity)  well  within  0.3  meter 
(one  foot)  error,  except  during  the  last  few  seconds  before  touchdown. 
Mditional  details  of  the  approach  are  shown  in  figure  5(b).  The  aerodynoiac 
flight  path  angle  (measured  with  respect  to  -die  air  mass)  is  shown  to  change 
to  about  , the  angle  that  would  be  e}q)ected  for  15.4  meters/seoond  (30 
knots)  of  wind  over  the  deck.  Pitch  attitude  changes  generated  by  'DVFCOS, 
thou^  probably  greater  than  a pilot  would  call  for  if  he  were  controlling 
attitude  directly,  did  not  appear  to  be  excessive. 

Comparisons  tetween  comnand  modes.-  Figure  6 shows  cceparisons 
between  vortical  velocity  ccranand  and  vertical  accjeleration  oomnand  as  they 
influence  the  nature  of  the  pilot  inputs  and  the  resulting  airplane  vertical 
response.  For  WC  with  ship  motion  (fig.  6(a))  the  stic:k  deflection  was 
characterized  by  more  or  less  continuous  activity  as  vertical  velocity 
corrections  were  required  following  initial  d^inming  at  tip-over.  As  he 
approached  the  ship,  the  pilot's  glide-path  error  infonnatian  fixm  the  FLOLS 
ijiproved  and  the  need  to  ti^ten  his  control  loop  (especially  in  the  presence 
of  deck  motion)  became  apparent.  The  increased  frequency  and  magnitude  of  his 
irputs,  beginning  at  about  37  seconds,  are  obvious.  The  ocnplete  stick 
deflection  time  hist(^  (in  addition  to  the  trim  input)  is  reflected  in  the 
rou^  connerided  vertical  velocity.  (Because  the  WC  mode  was  in  use,  rou^ 
ccnnmnded  vertical  acceleration  was  zero.) 

Figure  6(b)  shows  the  results  using  VAC,  with  the  same  time  history  of 
ship  motion  and  air  disturbances  that  was  used  for  WC.  In  this  case,  the 
stick  inputs  were  applied  more  in  the  manner  of  pulses,  with  more  time  spent 
at  zero  deflection.  The  rou^  ccnranded  vertical  velocity  took  on  more  the 
appearance  of  a succession  of  ramps  as  '^e  rou^  acceleration  pulses  were 
integrated.  Again,  the  effects  of  following  the  deck  motion  are  seen  in 
the  latter  half  of  the  rou^  conuanded  arvd  actual  vertical  velocities. 

Without  ship  motion  (fig.  6(c)),  the  VAC  inputs,  again  in  •d*  nature  of 
individual  pulses,  were  more  ij^requent  than  wi'di  ship  motion.  In  'dtis  case, 
since  there  were  no  other  disturbances,  the  pilot  at  aty  given  time  had  only 
to  apply  small  corrections  to  the  aircraft  motion  resxolting  from  his  own 
previous  inputs. 
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Response  to  gusts Figure  7 shows  a tine  history  of  the  airplane 
response  to  3isa?ete  3 meter-per-second  (10  foot-pcr«-6eoond)  vex*tioal  gusts 
iji'd:xxlaced  during  a naniial  approach  with  WC  selected  and  no  ship  notion  or 
other  distur^>ances.  These  gusts  were  more  severe  than  any  nOKnally 
encxxintered  in  practice  but  they  show  how  TAPCOS  was  able  to  respond  and 
control  fli^t  path* 

Vertical  acceleratic^  perturbations  of  1*8  meters  per  second  squared  (6 
feet  per  second  squared  or  0*2g)  and  angle  of  attack  perturbations  of  2*6 
degrees  due  to  the  gusts  are  noted  in  figure  7(a).  The  resulting  vertical 
velcxd.ty  and  the  error  between  instantaneous  and  saoath  ccnoanded  height 
(bottom  trace)  showed  pertuzhations  of  only  0.76  meter  per  secxsnd  (2.5  feet 
per  second)  and  about  2 meters  (6  feet),  respectively.  Some  pilot  stick 
response  to  the  first  (down)  gust  is  noted;  however,  essentially  no  response 
was  nade  to  the  onset  of  the  second  gust,  while  T^^FCQS  is  seen  to  have 
corrected  the  height  errcr  in  well  under  10  seconds. 

Figure  7(b)  shows  that  pitch  attitude  underwent  fairly  large  excursions 
(12.4^  TiHxijiun  to  6.5^  minium)  in  oonbined  response  to  the  ^ts  and  the 
stabilizer  deflections  applied  by  TAFOOS.  The  power  lever  sa>gle  and  thrust 
transients  that  were  requL?ed  to  hold  ccomanded  airspeed  were  signficant 
in  magnitude;  however,  recovery  to  a reasonably  normal  thrust  level  was  made 
about  five  seconds  prior  to  touchdown* 

Pilot  (laments 

General  ccmnents.-  Pilot  conments  indicated  that  general  acc^tability 
of  manual  trajectory  c^trol  through  1AFC0S  was  good*  Lateral-directional 
maneuvering  was  natural,  with  no  unus\^  or  adverse  characteristics . In  roll 
entries  and  reversals,  behavior  was  essentially  that  of  a roU-x^te  command 
system.  Lateral  neneuvers  to  oorrect  line-up  were  easy  to  make,  with  no 
lateral  PIO  tendencies  noted* 

Vertical  flight-*path  control  was  good,  with  smooth  response  to  coomands* 
Somewhat  exaggerated  pitch  attitude  changes  were  noted  as  TAFCOS  responded  to 
the  trajectory  ccncands*  These  excursions  seemed  somewi^t  xwiatural  and 
annoying  at  first  to  the  pilots  (who  are  accustomed  to  having  direct  control 
of  pitch  attitude)*  It  was  found  that  pilots  soon  adapted  to  this  response 
and  it  is  believed  that  with  practice  carrier  pilots  would  not  find  this 
characteristic  c^jectionable.  Speed  control  was  oonsidezed  excellent; 
response  to  speed  change  ocmnands  was  prciupt  and  precise* 

Effect  of  ship  motion  and  air  disturbances*-  Ship  motion  and  air 
disturbances  a l^Tge  effect  on  hei^t  control  close  to  1he  ship,  as 
reflected  in  the  ability  to  keep  the  meatball  centered*  This  difficulty  in 
turn  had  a degrading  effect  on  both  touchdown  precision  and  pilot  rating 
(discussed  later)* 

Effect  of  connand  mode*-  With  or  without  ship  motion  and  air  disturbances 
there  did  not  appear  to  be  ary  large  differences  in  results  using  vertical 
velocity  connand  or  vertical  acceleration  ccmroand*  With  ship  motion,  VAC 
sometimes  required  excessive  maneuvering  during  the  final  stages  of  the 
approach  to  keep  the  meatball  centered,  prd>ably  due  to  the  pilot's  not  having  a 
preset  coiiinanded  vertical  velocity  to  return  to  on  relaxation  of  his  control 
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input,  cr  his  tendency  to  use  a ”pulse-and-wait"  technique  with  VAC,  The  pilot 
clIso  reported  a need  to  mentally  integrate  his  acceleration  ccnnand  ir^ts  in 
an  atten5>t  to  predict  changes  in  vertical  veloci'^.  This  effort  was  not  a 
totally  fmitful  one  since  the  snooth  ccnmands,  not  the  rou^  ccnnands,  are 
the  OTes  integrated  within  TAFCOS, 

Although  the  WC  trim  control  provided  a "standard” . ocnnanded  rate  of 
descent  about  which  stick-coninanded  perturbations  could  be  made,  it 
constituted  an  additional  (retrinming)  step  in  the  control  procedure  \<hich 
was  not  required  with  VAC, 

Effect  of  variable  gain,-  De-sensitizing  the  vertical  velocity  response 
by  decreasing  pilot  input  oxitrol  gain  with  decreasing  iBnge  did  nBke  it 
easier  to  effect  snail  fli^t-path  carrections  near  touchdown,  but  tiiere  were 
cases  vdien  large  corrections  were  called  for  and  full  stick  inputs  were 
applied  without  obtaining  sufficient  corrective  response  fran  the  airplane. 
Constant  gain  was  prefereable  to  this  situation. 

Pilot  Rating  Data 

Figure  8 shcxre  pilot  ratings  obtained  during  the  study  using  the  Cooper- 
Haiper  scale.**  Hje  rating  data,  grouped  according  to  absence  or  presence  of 
ship  irotion  and  air  distuihancp*?  ^ were  based  on  10-run  sanples.  (For  those 
cases  with  ship  motion,  the  ship  drive  signal  was  * itiated  so  that  the  ver- 
tical deck  position  at  touchdown  was  not  repeated  iron  run  to  run,) 

Effect  of  ship  motion  and  air  disturbances,-  Figure  8 reflects  to  a 
larger  degree  the  pilot  connent  ma3e  earlier  regarding  effect  of  ship  motion 
by  showing  that  the  largest  single  factor  affecting  pilot  rating  was  the 
absence  or  presence  of  ship  motion  and  air  disturbances,  Al"diou^  ^0.9 
meter  feet)  of  vertical  deck  travel  would  be  considered  moderate,  it  did 
(in  combination  with  the  standard  ciir  wake)  add  considerably  to  the  pilot’s 
task.  If  one  considers  the  most  favorably-rated  case  in  each  nain  group 
(i.e.,  TAFCOS  with  WC,  constant  gain),  a degradation  of  at  least  fran  2 to  6 
is  noted.  The  reasons  given  by  the  pilot  for  this  degradation  were  increased 
difficulty  in  keeping  the  meatball  centered  prior  to  touchdown  and 
deterioration  of  touchdown  point  accuracy. 

Effect  of  cownand  mode.-  Althou^  the  evaluation  pilot  did  not  report 
any  large  dif?eren^s  te twe^  coimand  modes,  the  ratings  in  figure  8 with  or 
without  ship  motion  do  show  a degradation  in  going  from  WC  to  VAC,  The 
renarks  under  Pilot  Conments  for  the  case  with  ship  motion,  pertaining  to  not 
having  a preset  vertical  velocity  to  return  to,  pilot  use  ^ a pulse-and-wait 
control  technique,  and  attenpted  mental  integration  of  his  vertical  accelera- 
tion connand  inputs  apply  also  to  the  case  without  motion  and  appear  to 
substantiate  the  observed  changes  in  rating. 

Eff^t  of  v^iable  gain.-  Figure  8 shows  that  without  ship  motion  and 
air  disti54>aiK:es  t3Sere  was  no  effect  on  pilot  rating  of  decreasing  pilot 
control  gain  with  decreasing  range  using  WC.  However,  with  motion  a 
degradation  of  rating  across  the  6-1/2  boundary  occurred  v^en  going  frcm 
constant  gain  to  variable  gain.  The  occcisions  when  full  stick  inputs  to  mate 
large  corrections  (see  Pilot  Coiinents)  failed  to  generate  sufficient  airplane 
response  apparently  accounted  for  this  degradation. 
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ORlGJrcAL  PACE 

OF  POOR  QUALliY 


Approaches  witit  staytord  A-7E  wilh  APC»-  For  coBoparison  with  convwtional 
control,  apprv%y%>ws  up>n>»  atm  maH<»  wth  A-?£  aiiplane  with 

standard  control  system  and  approaidi  power  ocnpensator.  Figure  S shows 
less  favorable  ratings  for  the  conventionally-con'droUed  airplane  than  lor 
any  of  the  *D^FOOS  test  cases.  This  indication  was  less  apparent  witt:  ship 
motion  than  without  motion,  due  to  the  severe  effect  that  the  motion  ^d  on 
all  the  ratings  as  a result  of  the  increased  difficulty  in  keeping  the  meat- 
ball centered  close  to  the  ship. 

Touchdown  Performance 

Figure  9 shows  mean  and  standard  deviation  of  longitudinal  touchdown 
point  (based  on  the  10-nin  sanples)  for  all  the  oases  discussed  previously. 

The  line  segnents  extending  beyond  the  standard  deviation  bars  indicate  the 
total  spread  of  data  points  for  each  case.  The  horizontal  dashed  lines  show 
the  locations  of  the  four  arresting  wires.  To  give  a standard  for  ocnparison, 
it  is  seen  that  the  first  and  fourth  wires  were  18.3  meters  (60  feet)  fran.  the 
desired  touchdown  point,  which  is  shown  by  the  horizontal  axis.  Thus  a 
spread  extending  beyond  these  limits  would  mean  often  landing  short  or  missing 
all  the  wires  and  executing  a bolter. 

Generally,  the  larger  standard  deviations  shown  here  were  reflected  in 
the  less  favozeble  ratings  in  the  previous  figure,  and  vice  versa.  These 
relationships  were  fairly  consistent  'dxrou^iout  t^  stud^  and  the  standard 
deviation  data  follow  closely  the  pilot  oonments  in  support  of  the  numerical 
ratings  • 


CCHCUJDIM5  REMARKS 

Manual  control  of  aircraft  fli^t  path  Ihrou^  the  TAFCOS  concept  has 
been  shown  to  be  feasible  as  an  addition  to  a pre-existing  automatic  control 
system  and  to  }ave  potential  as  an  inproved  mo^  of  control  over 
conventional  control  for  the,  carrier  approach  task.  Further  optimization  and 
development  studies  need  to  be  made  to  explore  this  potential  fully  and  to 
determine  what  degree  of  ieprovement  can  be  realistically  e3q>ected. 
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Figure  !•-  TAFCOS  structure  - conceptual  diag: 
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Figure  2.-  TAFCOS  signal  flow 
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Figure  5,-  Time  history  of  a manual  carrier  approach  with 
TAFCOS*  vertic.  - velocity  command 
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Figure  5.-  Concluded. 
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Figure  6.—  Comparison  between  TAFCOS  vertical  velocity 
command  and  vertical  acceleration  command. 
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Figure  6.*'  Continued. 
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Figure  6.-  Concluded 
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figure  7,-  Time  history  of  response  to  diaerete  gusts. 
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Figure  8.-  Pilot  rating  data. 
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ABSTRACT 


Wind  Shear  Siaulation  Experiaents 

Hark  Connelly 

Informatlor  and  Declaion  Systens  Laboratory,  Caabrldge,  MA 

A set  of  simulation  es^riments  has  demonstrated  the  effects  of 
various  levels  of  horizontal  %iind  shear  and  the  presence  of  thunderstorm  cells 
on  instrument  landing  performance.  A theoretical  analysis  was  carried  out 
showing  what  control  inputs  are  necessary  to  compensate  for  vertical  and  hor- 
izontal wind  shears.  A final  set  of  simulation  experiments  using  the  suggested 
control  technique  indicates  that  a substantial  reduction  in  the  effects  of 
shear  can  be  obtained  by  displaying  the  proper  dynamic  information  to  the 
pilot  in  a timely  ^'«shion. 

ABSTRACT 


Combined  Use  of  Airborne  Traffic  Situation  Displays 
And  4DRKAV  In  ATC 

TWO  key  tasks  in  the  application  of  distributed  managesmnt  to  the  prob* 
lem  of  providing  adequate  ATC  capacity,  safety,  and  efficiency  at  busy  terminals 
are:  (1)  To  follow  a 3D  terminal  aerospace  strwture  and  arrive  at  fixed  waypoints 
%rithin  the  structure  precisely  at  pre^scheduled  times  in  the  presence  of  a 
full  range  of  wind  conditions  aloft  (2)  To  monitor  nearby  traffic  on  an  air- 
borne traffic  situation  display  to  detect  blunders  and  resolve  conflicts  in  a 
safe  manner.  This  paper  describes  a series  of  simulation  es^riments  carried 
out  to  evaluate  both  of  these  functions. 
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APPLICATION  OF  A PILOT  CONTROL  STRATEGY  IDERTIFICATIQN  TECHNIQUE 
TO  A JOINT  FAA/NASA  GROUND-BASED  SDtlLATION  OF 
HEAD-UPj)ISPLAYS  FOR  CTOL  AIRCRAFT* 

Wayne  F.  Jewell 
Staff  Engineer^  Research 
Systems  Technology,  Inc. 

2672  Bayshore-Frontage  Road 
Mountain  View,  California  S^k3 

ABSTRACT 

A techniq,ue  for  measuring  a pilot*  s control  strategy  has  been  dereloped, 
evalimited,  and  applied  to  a realtime  ground**based  simulation  • The  technique, 
called  the  Non-Intarusive  Pilot  Identification  Program  (HIPIP),  estimates 
the  pilot’s  input-output  describing  function  and  cozsbined  pilot-vehicle 
performance  parameters  such  as  crossover  frequency  and  phase  by 

using  a time  domain  model  of  the  pilot  and  a leas'^'-squares  identification 
algorithm.  5IPIF  functions  in  realtime  and  uses  a ’’sliding”  time  irindoir 
to  maintain  freshness  in  the  data;  thus  time-varying  characteristics  in 
the  pilot’s  control  strategy  can  be  measusred. 

This  paper  describes  the  salient  feattxres  of  HIPIP,  presents  the 
results  of  a perfoniance  evaluation  of  HIPIP,  and  then  describes  the 
results  of  applying  HIPIP  to  a realtime  ground-based  simulation  of  two 
competing  concepts  of  head-up  displays  (HUB)  for  use  in  conventional  take- 
off axid  landing  (CTOL)  aircraft.  Differences  in  the  pilot’s  control 
strategy  used  for  the  tifo  HUDs  auid  the  head-down  display  are  quantified 
in  terms  of  differences  in  the  pilots*  describing  functions  and  coidE)ined 
pilot-vehicle  measurements . Conclusions  based  on  the  performance  evaluation 
and  application  of  HIPIP  are  presented  and  some  recoamieodations  on  hoir  HIPIP 
could  be  used  in  other  manual  control  tasks  are  discussed. 

IHTRODUCTIOH 

A technique  for  measuring  a pilot’ s control  strategy  has  been  developed, 
evaluated,  and  applied  to  a Joint  FAA^IASA  ground-based  simulation  of  two 
competing  concepts  of  head-up  displays  (HUB)  for  vise  in  conventional  take- 
off and  landing  (CTOL)  aircraft.  The  technique,  called  the  Hon- Intrusive 
Pilot  Identification  Program  (HIPIP),  estimates  the  pilot’s  input-output 
describing  function  and  combined  pilot-vehicle  performance  parameters  such 
as  crossover  frequency  and  phase  margin  by  using  a time  domain  model  of  the 
pilot  and  a least-squares  identification  algorithm.  HIPIP  functions  in 
realtime  and  uses  a ”slidf  g”  time  window  to  maintain  freshness  in  the  data; 
thus  time-varying  characteristics  in  the  pilot' s control  strategy  can  be 
measured. 


• This  work  was  sponsored  by  the  Man-Vehicle  Systems* Research  Division  at 
the  KARA  Ames  Research  Center,  Moffett  Field,  Califorxxia,  binder  contract 
HAS2-1036^.  The  HASA  contract  technical  monitor  was  Dr.  Richard  Haines. 
The  ground-based  simulation  was  a Joint  FAA/HASA  bead-up  display  concex^ 
evaluation  project  conducted  under  Task  Order  D0T-FA77  WAI-725  to 
Inter-Agency  Agreement  NASA-HME  1052.151  dated  March  9>  1977* 
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PRECtua^iu  Fa'oi 


• UcV 


This  paper  is  divided  into  the  fOUovliig  sectloos: 

• Description  of  the  salient  features  of  RIFIP 

• Perfomnee  evaluation  of  HIFIP 

• Application  of  NIPIP 

• Conclusions  and  recoonendations . 

The  treatiaents  of  each  of  the  above  topics  in  this  paper  are  intentionally 
terse.  More  in*depth  and  detailed  treataents  will  be  presented  in  a forth* 
coning  HASA  contractor  report^ « 

SAuarr  teator&s  of  hipif 

The  function  of  HIPIP  is  to  estlsnte  the  describing  function  of  the 
hunan  operator  (BD)  vhile  perfonaing  a aultUoop  cmtrol  task  such  as 
flying  an  aircraft.  HIPIP  antes  use  of  «ell*proven  reduced*order  nodele  of 
the  ID  dyoaJBics^  and  is  veil  suited  for  easy  iaplenentatlon  on  nodero,  hi^ 
speed  distal  coaqputers. 

One  of  the  design  criteria  of  HIPIP  vas  that  it  be  able  to  obtain 
aeastxreaents  of  the  B0*s  control  strategy  in  a realtlne  8lJB^ation  environ* 
nent  on  a non*interfering  basis,  which  is  why  it  is  referred  to  as  ”non* 
intrusive."  The  result  was  an  algorithn  that  la  fast  enou^  and  efficient 
enou^  to  coexist  with  the  essential  conponents  of  a realtiae  aircraft 
siaailator.  Furthemore,  5IPIP  is  slaq^  enou^  to  use  on  a routine  basls^ 
without  the  use  of  special  iLputSi  disturbances,  or  other  alterations  to 
the  integrity  of  the  sioulation. 

While  there  are  a maber  of  techniques  available  for  identifying  H) 
dynamics3*T^  HIPIP  is  unique  in  «.i\at  it  can  identify  the  tlM^varying 
characteristics  of  the  B>,  does  not  reqjoire  teowledge  of  the  disturbance, 
and  can  function  in  realtiae.  This  last  attribute  is  advantageous  because 
It  allows  a researcher  to  aonitor  the  H)*a  dynaaic  behavior  as  he  is  per* 
foraing  ^ control  task.  The  foUoving  text  briefly  describes  the  require* 
aents  for  using  HIPIP  as  well  as  the  inputs  and  outputs  of  HIPIP. 

Ihe  first  step  in  using  HIPIP  is  to  synthesize  a loop  structure  of  the 
pilot*vehicle  system.  This  can  be  based  on  control  system  analysis  and/or 
obBervmtlon  of  the  B)  behavior  in  perfoxving  the  required  task.  The  next 
step  is  to  represent  the  elements  of  the  hunan  operator  in  the  loop  struc* 
ture  with  discrete  transfer  functions.  It  is  shown^  that  reduced  order 
foms  of  the  BO  dynaaics  can  be  used  for  the  discrete  transfer  functions. 
Then  one  writes  difference  equations  using  the  loop  structure  and  discrete 
transfer  functions.  The  parasieters  of  the  difference  equations  are  esti* 
Bated  by  using  a running  aultiple  linear  regression  and  a sliding  tiae 
window. 

The  running  multiple  linear  regreaslon  starts  processing  the  tiae 
histories  of  the  pilot's  control  actions  and  the  variables  to  be  controlled 
until  it  fills  up  a specified  tiae  window.  Once  the  time  window  is  filled 
up  HIPIP  slides  the  window  along  the  tins  history,  thus  identifying  any 
tiae  varying  characteristics  in  tbB  pilot's  control  strategy.  The  raw  out* 
puts  of  HIPIP  are  the  difference  equations  coefficients  (DEC).  It  was 
discovered  that  the  DBC  would  behave  very  strangelv  under  certain  clrcuar 
stances  (e.g.,  for  tias-varyixig  behavior  of  the  BD),  but  the  ftequency 
response  of  the  W>  wes  very  well  beheved.  Thus  the  last  step  for  HIPIP  is 
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to  interpret  the  results  in  the  frequency  doomin.  It  does  this  by  coovutln^ 
frequency  responses  of  the  estixaated  eleaents  of  the  B3  In  the  loop  structure 
(i.e.,  describing  functions)  and  coohined  pilot^vehicle  oieasures  such  as 
crossover  frequency  and  phase  margin. 

A loathematical  treatment  of  the  NIPIP  algorithm  can  be  found^ , and  will 
net  be  repeated  in  this  paper.  Instead  we  will  present  herein  the  results 
of  a performance  evaluation  of  NIPIP. 

PERPORMABCE  EVALOATION  OF  NIi'IP 

Figure  1 shows  the  construct  used  for  the  performance  evaluation  of 
NIPIP.  The  approach  taken  was  to  integrate  NIPIP  into  a simulation  of  a 
Boeing  727  aircraft  along  with  the  control  Laws  of  the  fli^t  director  and 
fast/slow  speed  error.  Ai.alog  pilots  were  used  to  control  the  tllgtit 
director  with  the  control  column  and  the  fast/slow  error  with  the  throttle. 
Shaped  white  noise  was  used  to  simulate  pilot  remnant  and  injected  into 
the  control  loop  as  shown  in  the  figure.  The  pilot-vehicle  system  was 
disturbed  with  the  Dryden  model  of  atmospheric  turbulence?. 

The  construct  ^hown  in  Fig.  1 pexmivted  a comparison  of  the  known 
parameters  of  the  analog  pilot  to  tne  estimaxed  outputs  of  NIPIP  in  a known 


Figure  1 . Construct  Used  for  the  Jy^rformance  Evaluation  of  NIPIP 
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In  addition  to  eralnating  the  effects  of  idiot  reanact  oa  the  outputs 
cf  ZZrn,  the  effects  of  variations  in  the  following  itsM  were  also 
evaluated: 

1 . Length  of  the  sliding  tine  window,  1^.  The  larger  the 
value  of  1\|  the  better  the  estimated  tp.  The  tradeoff 
to  te  considered  is  that  the  tine  ■varying  characteristics 
of  Tp  are  aashed  for  larger  values  of  1^. 

2.  Tine  variations  in  Tp.  That  is,  HP1P  was  used  to 
identify  contrrlled  variations  in  the  paraaeters  of  the 
analog  pilot,  Tp. 

3.  ffMber  of  degrees  of  freedoa  (DCF)  in  If  the  nunber 
of  DOP  in  4p  differs  froa  those  in  ^ how  does  this 
affect  MlPlf^s  abilxty  to  estiaate  ^7 

Pure  tiae  delay  in  Tp.  Bow  does  a ptxrc.  tine  delay  Li 
Tp  affect  the  estiaate  cf  $p7 

of  the  effects  listed  above  are  described  in  detail* . For  brevity 
only  the  effects  of  pilot  reaoent  will  be  discussed  herein,  the  effects  of 
which  are  smaarized  in  Fig.  2.  The  figure  contains  the  ffe<ptenc>  *^.^spon«*r 
of  the  actual  analog  pilot  for  the  flight  director  :jOop  and  ti^  .^.^iuaated 
describing  fonctlons  for  three  levels  of  siaulated  pilot  reanant  (for  zero 
reansnt  the  estlKated  and  actual  frequency  responses  axe  identical). 

The  procedure  used  to  drew  Fig.  2 was  to  use  the  sliding  window  in  HFIP 
to  obtain  a large  nunber  of  estiaates  for  %p.  This  peralttad  us  to  specify 
bounds  on  the  upper  and  lower  Halts  of  ths  estiaated  for  a given  Level 
of  reanant.  The  figure  shows  that  the  bounds  are  freq;uency  dependent,  with 
less  than  .t  1 dB  error  in  |)p(ja>)l  at  or  below  ' rad/sec  (the  crossover 
freq^sney  of  the  fli^t  director  loop  was  1 rad/sec)  and  a of  about 

> 3 dB  error  at  8 ra^sec.  The  frequency  dependence  of  the  error  in 
|tp(j<D)|  is  attribul  1 to  the  lcwr*band  pass  filters  on  both  the  ataospheric 
turbulence  and  the  reanant.  The  marlaaa  error  in  4 Tp(  jo)  was  about  ± 3 deg 
and  did  not  appear  to  be  a strong  fmetion  of  frequency. 

Also  note  fTca  Fig.  2 that  the  effects  of  reanant  are  non-linear. 
Doubling  the  si^al-to-noise  ratio  froa  22  to  44  percent  did  not  double 
the  errors  In  Tp(ja>). 

Wingrove?  deaonstrated  that  acae  identification  tochniques  will  not 
functici  properly  when  large  saonnts  of  reanant  are  present.  There  can  be 
biases  in  the  estiaates  or  a tendency  to  identify  the  inverse  plant.  The 
results  shown  in  Fig.  2 deaonstrate  that  HIFIP  is  not  subject  to  either  of 
these  problesa. 

APPUCAnOH  OF  HIPIF 

KIPIF  was  applied  to  the  siaulator  evaluation  of  three  aircraft  displays 
lor  use  Id  tezainal  area  navigation.  Siaplified  sketches  of  the  three 
displays  and  a suMsry  of  the  display  laws  are  shown  in  Figs.  3,  4,  ax»i  3. 
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Figure  4.  Sljqpllfied  Sketch  of  Flight  Director  HUD 


401 


ORIGINAL  PAGE  \S 
OF  POOR  QUALITY 


• 6 


'IIS 


© 


X 


FD^ 


FS 


Display  ccDtrol  Unm: 


TOe  • 

AFy  ♦ f ^ *«2VS 

FS  • 

s ♦ 1 ,0  * ^raf' 

’'hud  ■ 

'V  V a ♦ 2.5 

- 

■’'hst  “ Vs 

’'hkf  ■ 

IIS  gUite  slope  (•  y 

« iDMTtiAl  fli^t  path  aa^  of  aircraft 


Status:  Aircraft  is  pitched  up  3 deg  axil  on  a 2 deg  flight 
path  aagle.  Glide  slope  is  3 deg  above  aircraft. 


- k 


- 2 


-•2 


-•6 


--a 


-10 
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Tte  reference  display.  Fig.  3,  wee  e coDrentlooal  beadrdom  ADL/fBl 
tilth  cross  hairs  used  to  ^splay  the  flt^t  director  slgnals^^.  The 
head*dcMi  displi^  included  the  nozml  cce^ownt  CIOL  Instniaentatioae 

There  were  two  com^tlng  concepte  of  head*tip  displnys.  The  first  eas 
called  the  flight  director  9JD,  Fig.  k,  and  used  a fixed  aircraft  s^ahol 
and  a aovlng  dot  to  display  the  vertical  and  lateral  guidance  waands^^ . 

The  second  HUD  uas  called  the  flight  path  HUD,  Pig.  and  used  a conform! 
display  of  the  aircraft  flight  path  angle,  the  reference  gUde  slope,  and 
an  angle  that  is  proportional  to  the  glide  slope  error^^.  For  this  display, 
an  effective  flight  director  signal  can  be  fbrmd  by  using  the  difference 
between  aircraft  flight  path  and  glide  slope  angles. 

The  aircraft  was  a cooventional  Jet  transport  and  was  siaulated  cm  a 
ftiLL  six  degrees  of  freedom  motion  siaulator  with  u color  visual  display^^. 

The  sijBulatlon  was  i,estricted  to  terminal  area  navigation  but  the  pilots  did 
have  to  transition  from  a strai^t  and  level  flight  condition  at  l6o 
to  a *3  deg  flii^t  path  angle  at  about  130  kt  was  chosen  by  the  pilots). 

The  data  presented  in  this  report  was  for  an  ms  Dryden  model  turbulence 
level  of  3*0  fps.  Ho  discrete  wind  shears  were  slailated. 

The  pilot  subjects  used  in  the  simulation  were  eleven  professional 
airline  captains.  Three  of  the  subjects'  data  were  selected  for  detailed 
analysis,  the  results  of  which  are  presented  and  discussed  below. 

The  overall  objectives  of  the  simulation  were  to  compare  the  CTOL  head* 
down  display  to  the  two  head*up  displays  and  to  docment  any  advantage  to 
using  a head*up  display.  Many  different  types  of  data  v^re  collected  and 
analyzed  in  support  of  these  objectives.  However,  for  the  purposes  of  this 
paper,  only  those  data  related  to  the  pilots'  control  strategy  will  be 
presented  and  discussed  herein. 

A summary  of  the  experimental  results  related  to  the  pilots*  control 
strategy  obtained  ffom  the  simulatic^  is  shorn  in  Table  1 . A discussion  of 
the  results,  and  some  of  the  data  used  to  support  these  results,  is  con* 
tained  in  the  following  text. 


TABUS  1 

SXFERIHEHTAL  R£SUL!1S 

• Behavioral  variation  from  display*to*dispIay 

• Behavioral  variation  from  pilot-to-pilot 

• Identification  of  tlme*varying  behavior 

• Detection  of  control  strategy  errors 


Figure  6 shows  a plot  of  crossover  frequency,  o^,  plotted  agaixist 
phase  margin,  for  each  of  the  three  displays  and  three  of  the  subject 
pilots.  The  head*down  data  is  plotted  separately  from  the  HUD  data  because 
the  display  lavs  were  different,  which,  of  course,  cc.used  the  controlled 
element  dynamics  to  be  different. 
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b.  Head-Doen  Flight  Director  (bottoi  ihadad) 

Figxire  6.  Coabined  Pllot*Vehicle  Meaiurenanti 
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It  can  ba  seen  frca  Fig.  6 that  similar  pilot  bebarior  for  the  two 
types  of  bead*\ip  displays  vas  obtained  although  there  vas  a d^.flnite  trend 
toNard  flying  the  flight  path  HUD  with  a hi^ier  bandwidth  and  lower  cross- 
over frequency  than  with  the  flight  director  HUD.  The  variability  among 
the  three  pilots  was  fairly  low  for  the  two  bead-up  displays  but  quite 
large  for  the  headrdown  display.  However,  within  each  pilot's  data  there 
%ras  fairly  1cm  variability,  which  indicated  that  a pilot  wcmld  adapt  his 
Gwn  personal  conblnation  of  cu^  and  Also  note  that  the  trwds  in  the 
head-up  versus  the  bead-down  displa^  were  opposite.  That  is,  increasing 
corresponded  to  decreasing  ^ for  the  bead-up  display  but  Just  the  op- 
posite for  the  bead-down  displ^.  This  difference  was  not  surprising  and 
is  due  to  the  difference  in  the  controlled  element  dynamics. 

Examination  of  the  describing  function  data  revealed  that  all  the  pilots 
were  able  to  fly  the  head-up  displays  with  a fairly  high  gain  and  use  lead 
CGopensation  in  their  control  strategy.  But  the  describing  functions  for 
the  head-down  display  exMbited  a low-bandwidth,  and  a very  laggy  type 
control  technique.  Some  sample  describing  functions  obtained  from  the 
simulation  will  be  presented  in  a forthcoming  HASA  report^ . 

Thus  mPIP  was  able  to  use  coaibined  pxlot-vehicle  and  describing  function 
measures  to  discern  behavioral  variations  from  display  to  display  and  fits 
pilot  to  pilot. 

The  pilot's  describing  functions  exhibited  a trend  in  time-varying 
behavior  when  using  the  flight  director  HUD  and  head-down  display  but  to  a 
much  less  degree  when  using  the  flight  path  HUD*  Usually  what  the  pilots 
did  was  to  increase  their  gain  and  decrease  their  control  latency  as  they 
became  closer  to  the  minliaaB  decision  altitude.  This  effect  is  demonstrated 
in  the  describing  functions  shown  in  Fig.  7- 

NIPIP  was  able  tc  detect  control  strategy  errors  with  the  head-down 
display  and  the  flight  path  HUD.  These  were  due  to  control  reversals  with 
the  head-down  flight  director  and  due  to  accidentally  using  the  wrong  element 
in  the  display  with  the  flight  path  HUD*  The  time  history  of  Fig.  8 sbimrs 
bow  a control  strategy  error  is  manifested  in  the  HIPIP  measiorements  • 

After  ^jreaking  out"  (i.e.,  beneath  the  clcud  cover)  the  pilot  apparently 
became  conf«::sed  as  to  %rhich  syoibol  to  track  in  the  display.  This  caused  an 
instability  in  the  flight  director  loop.  That  is,  positive  feedback  of  the 
flight  director  to  control  column  (viz..  Item  6 in  the  figure).  This  sudden 
change  in  control  strategy  caused  a shai^  decrease  in  the  angditude  and 
phase  of  and  corresponding  decreaises  in  crossover  frequency  and  phase 
margin.  Tne  unstable  condition  lasted  for  only  a few  seconds  b\xt  it  was 
interesting  that  NIPIP  responded  to  the  control  strategy  error  before  the 
pilot  was  aware  of  it.  In  fact,  when  the  pilot  did  become  aware  of  it,  he 
acttiaUy  screamed  and  then  rapidly  applied  the  proper  control  action. 

The  time  history  of  Fig.  8 also  demonstrates  how  NIPIP  converges  after 
the  transition  from  straight  and  level  fli^t  to  a -J  deg  glide  slope 
(Item  8 in  the  figure).  NIPIP* s response  to  the  flare  and  landing  is  also 
shown  in  Fig.  8. 

CQNCLU5I0SS  AND  BBCOFMEHDAIIONB 

An  empirical  evaluation  of  the  Non-Intrusive  Pilot  Identification 
Program  (NIPIP)  has  demonstrated  that  accurate,  unbiased  estimates  of  a 
pilot's  control  strategy  in  performing  man;wi1  control  tasks  can  be  obtained 
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Figure  7 • Describing  Function  Frequency  Response  Using 
FUght  Director  HUD  (Pilot  9,  Run  3§6) 
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eren  in  the  presence  of  pilot  reanant.  Furtheznore,  it  is  possible  to  'ise 
HIFIP  for  multiloop  control  tasks  without  the  use  of  special  inputs  or 
disturbeuices « Tiae-^variations  in  the  pilot's  control  strategy  are  ideuti-* 
fled  by  NIFIP  throii^  the  use  of  a "sliding  tixae  window." 

NIPIP  was  applied  to  a realtizae  groundrbased  simulation  of  two  c^snpeting 
concepts  of  head-up  displays  and  a conventional  head-dam  display.  It  was 
shown  that  behavioral  variations  in  the  pilot's  control  strategy  from  display 
to  display  and  from  pilot  to  pilot  could  be  measured  by  SIPIP.  It  was  also 
shown  that  SIPIP  could  identify  time-varying  behavior  in  the  pilo'j  and 
detect  certain  types  of  control  strategy  errors. 

For  the  simulation  described  herein  no  attempt  was  made  to  correlate 
the  objective  measures  of  SIPIP  with  subjective  assessment  of  the  task 
workload  or  pilot  preference  for  a particular  type  of  displjay.  It  is 
reccoaended  that  these  types  of  subjective  measurements  be  made  in  future 
applications  of  SIPIP  in  order  to  calibrate  the  objective  measuieiBents  of 
SIPIP  with  pilot  opinion  data. 

The  application  of  SIPIP  described  herein  was  to  a research  project  in 
a ground-based  simulator.  It  would  be  possible  to  use  SlPiP  fcr  many  other 
types  of  control  tasks^  whether  simulated  or  in  actual  lli^t.  One 

such  application  is  in  the  field  of  flight  training.  By  using  SIFIP^  an 
instructor  could  monitor  the  performance  and  learning  trends  of  the  student 
pilots  instead  of  just  the  performance  of  the  conhined  pilot-vehicle  system. 
Improper  or  erroneoias  control  techniques  could  be  identified  an^.  the  student 
informed  of  the  problem. 
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-Abatract- 

Recently  aviation  aafety  workera  have  axpreaaed  concern  about  the 
ability  of  general  aviation  pilota  to  cope  with  a total  vacuua  syatea 
failure  during  flight  in  inatrunent  aetaorological  conditiona.  Such  a 
failuree  leavea  the  pilot  with  only  a tum>rate  gyro  to  Maintain  winga- 
level  flight.  Two  difficultiea  lead  to  thia  concern.  Firat,  '.he  pilot 
generally  haa  aona  difficulty  in  flying  the  airplane  by  reference  to  the 
turn-rate  gyro,  the  inclinomter,  and  the  airap^  indicator  (the  so- 
called  needle,  bell,  and  airspeed).  The  second  difficulty  arose  with 
the  introduction  of  the  turn  coordinator  which  uses  an  outside-in  presen- 
tation — the  reverse  of  the  pilot's  priaary  attituds  gyro. 

To  evaluate  the  severity  of  the  problee,  a flight  experimant  was 
designed  using  a Cessna  172  airplane  with  the  vecuue  syatea  nodifisd  to 
perait  total  failurs  of  the  attitude  and  dirsetional  gyros.  Nine  sub- 
ject pilots,  ranging  in  axperisnee  froa  170  to  5100  hours,  flew  aiaulated 
(hooded)  instruaant  aiasions  with  an  unexpactad  gyro  failure  introduced 
at  a critical  point.  All  subjects,  axcept  for  tha  170  hour  pilot,  wore 
inatruaent  rated.  (The  170  hour  pilot  was  a private  pilot  working  on 
his  instruaant  rating.) 

All  of  the  subject  pilota  were  able  to  aaintain  control  of  the  air- 
'.ane  following  tha  gyro  failure.  Only  one  subject  exceeded  the  a priori 
critarion  of  losing  a aaxlaua  of  250  feet  of  altitude.  None  of  thia  subjects 
flew  a aatiafactory  VOR  approach  following  tha  failure:  however  all  would 
have  found  the  airport  safely  given  a csiling  of  1000  feet  or  better. 


-Introduction- 

During  flight  in  inatruaent  aeteorological  conditions  (INC),  the 
pilot  is  wholly  dependent  on  his  flight  instruaents  for  the  cues  .nec- 
essary to  control  the  airplane.  In  particular,  tha  attitude  and  direc- 
tional gyros  provide  vital  cues  tha  pilot  needs  to  aaintain  orientation 
in  the  absence  of  a visual  ground  rsfarsnee. 

Brth  of  thaaa  gyroscopic  instruaents  are  susceptible  to  damage  from 
violent  aanuevera  and  to  failures  because  of  their  coaaon  power  supplies. 
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To  prevont  total  loss  of  control  if  sittisr  or  both  ^yros  fail,,  a back- 
up inatrumnt  is  raquirad  for  flight  in  IHC.  Light  airplanas  use  a 

tum-rata  indicator  which  shoes  the  rate  of  yaw.  This  inatruaent 

relies  on  gyroscopic  precession  to  deflect  a needle  an^ is  therefore 
■uch  eore  physically  robust  ttan  conventional  attitude  end  directional 
gyros.  This  eeans  that  it  is  euch  lass  likely  to  be  danagad  in 
a eanuever.  To  preclude  loss  of  control  ..i  the  event  of  a power  supply 
failure,  turn-rate  indicators  are  usually  powerso  aaparately  froe  tha 
other  two  gyros.  Most  light  airplanes  uas  vacuue  powered  attitude  and 
heading  gyros  (froa  an  engine  driven  vacuus  puap)  ana  electric  turn-rate 
indicators.  However  there  ia  no  requlreaent  for  aaparatw  power  auppiiaa 
in  single-engine  airplanes.  These  flight  inatruaents  and  their  character- 
istics are  discussed  in  several  inatruaent  flight  aanuals  published  by 
the  US  governaent(j^,2^) . 


-Stateaent  of  the  Probloa- 

It  ia  such  sore  diCficult  for  a pilot  to  fly  an  airplane  using  the 
tum-rats  indicator  than  the  other  ce.''  gyro  instruoants.  This  is  wall- 
known  to  any  inatruaent  rated  pilot.  1 .a  reasons  are  threefold^  First, 
the  dynaoics  of  the  turn  Indicator  shows  yaw  rates,  not  roll  inforaatlon 
or  heading.  Tfus  has  been  partially  coapsnsatsd  for  in  recant  designs  by 
tilting  the  axis  of  tha  gyro  to  produce  aoae  aeaoure  of  roll  rate  fnfor- 
aation(2)«  Second,  tha  turn-rate  indicator  provides  no  pitch  attitude 
infomation.  The  pilot  oust  obtain  this  froa  hia  airapaed  or  vertical 
spaed  iiidicator.  While  the  airspeed  con  be  used,  thaas  prsMure 
instruoants  have  built-in  lags.  Third,  the  display  foraat  is  quite 
different  from  the  nomol  presentation.  The  pilot  oust  use  several 
instruoants  to  obtain  hie  data.  In  edition,  the  tilts.-,  .te-gyroe 
in  recant  vogue  uae  a foraat  that  appears  superficially  the  saoe  oa  the 
attitude  gyro.  However,  the  esnas  of  the  notion  is  reveraed.  ' . 

During  initial  inatruaent  training,  a great  deal  of  tine  i.'  apant 
drilling  the  student  on  flying  with  only  the  turn-rate  indicat.-  , tha 
so-called  partial  panel.  Virtually  all  of  this  training  is  acconplished 
by  covering  the  attitude  and  directional  gyros  and  havi^  tha  student 
fly  using  only  "needle,  ball,  and  oirapeed." 

Although^  tha  studmt  is  trainedto  fly  by  referonee  to  the  cum  indi- 
cator, he  is  given  no  oxperianca  in  detecting  priaory  gyro  failures. 

These  failures  con  ba  described  as  precaasion,  tuabling,  or  freezing. 

Froa  a pilot's  point  of  view,  precession  appears  to  baslightly  erratic 
notions  in  both  pitch  and„roll_witi;ra  randan  input.  The  heading  shown 
on  the  directional  gyro  slowly  drifts.  The  cause  of  procession  can 
ba  dirty  bearings,  a binding  giabal,  or  low  gyro  apaed. 

Tuabling  is  a violent  precession,  usually  eauv.jd  by  a Iwnuever  that 
causes  the  giabal  to  strike  the  stops.  It  can  be  caused  by  a conpleta 
power  failure.  To  the  pilot,  this  appears  as  if  .the  atttLudf  9yro_wfre 
swiaaing  in  its  diopla*/.  The  directional  gyro  aitply  api'is.  if 
the  tuoblirg  was  caused  by  exceeding  the  gyro  linlte  iii  pitch  or  roll, 
the  erection  oechanian  will  slowly  return  the  gyros  to  norwol  operation. 

rroozing  of  the  gyros  can  ba  caused  by  aachonical  b^  or  by  a 
caging  aschonisa  designed  to  prevent  tuabling  whan  power  ih  isoov^.  Thus, 
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under  %am  circuntances»  e coMplete  poiver  failure  eilX  not  result 
in  tuflblinqv  but  eilX  produce  an  unaoving  display.  This  null  failure 
can  be  quite  difficult  for  the  pilot  to  detect. 

^^'.ure  of  the  co— on  pceer  .Aipply  (vaciMia  puap  failure)  can  produce 
pre  jn  errors  in  both  gyros  if  the  failure  is  partial.  It  can  pro- 
duce tufloling  (spinning)  or  freezing  errors  if  the  failure  is  coaplete. 
During  the  preliainary  developaent  of  this  paper » ee  undertook  to  observe 
an  actual  vacuua  system  failure.  A Cessna  172  was  floimi  to  12»300  ft 
and  the  engine  shut  doivn.  Approximately  four  minutes  later*  passing 
through  9*000  ft*  the  attitude  gyro  failure.  The  failure  mode  vas  not 
apparent  except  by  obse^.  jnq  the  outside  visual  reference.  Holding  zero 
pitch  and  roll  on  the  indicator*  the  airplane  rolled  into  a thirty 
uegree  bank  spiral  approximately  five  to  ten  degrees  nose  doan.  There 
eas  no  indication  of  tunbling  or  failure  of  the  gyro  itself.  The  failure 
was  fairly  aloe  in  developing. 

The  turn-rate  indicator  is  also  subject  to  errors.  Becau^  of  its 
design  as  a rate  gyro*  precession  is  a normal  event.  Vne  turn  indication 
IS  simply  a measure  o^  the  precession  force  caused  by  rotation  about  the 
airplane's  vertical  axis.  The  only  possible  malfunctions  involve  slowing 
or  stopping  of  the  gyro.  These  appear  as  decreased  sensitivity  or  as  no 
turn  indication  at  all* 

Several  factors  can  influence  the  ability  of  the  pilot  to  detect  and 
cope  tfith  gyro  failures.  These  are  his  proficiency*  his  training*  and  the 
instrument  panel  design. 

Pilot  proficiency  includes  recency  of  instrument  flight  experience* 
cunency  in  the  airplane*  and  proficiency  in  partial  panel  flight.  Vlhile 
a proficient  pilot  can  certainly  fly  a much  smoother  profile*  it  does  not 
necessarily  follow  that  he  will  be  able  to  detect  instrument  failures  more 
quickly  just  by  virtue  of  his  currency.  However*  a proficient  pilot  may 
have  a lo««r  workload  than  a non-proficient  pilot  for  the  same  task*  which 
may  help.  Recency  of  partial  panel  flying  experience  is  more  likely  to  be 
significant  than  the  other  factors*  however. 

Pilot  training  includes  both  initial  training  in  instrument  flying 
and  any  experience  the  pilot  may  have  had  in  detectiing  instrument  failures. 
Obviously*  few  pilots  at  present  have  had  any  training  in  the  recognition 
of  a vacuum  pump  failure.  0n]y  those  pilots  who  have  either  personally 
experienced  an  instrument  failure  or  who  have  had  a close  associate  who 
has  experienced  on  will  even  be  aware  of  the  problem. 

Instrument  panel  design  includes  such  factors  as  warning  ievices  (in- 
cluding vacuum  gauges)  aix]  the  design  of  the  instruments  themselves.  One 
factor  that  makes  partial  panel  flight  more  difficult  is  the  different 
sense  of  motion  in  recent  turn-rate  indicators.  These  new  instruments 
present  the  turn  in  an  outside -in  format  as  opposed  to  the  conventional 
inside-uut  artificial  horizon.  The  different  sense  of  motion  could  have  a 
negative  effect  both  in  detecting  an  attitude  gyro  failure  and  in  flying 
the  airplane  afterwards. 

Difficulties  in  coping  with  gyro  failures  were  reported  by  the  National 
Transporcation  Safety  Board*  who  reviewed  several  fatal  general  aviation 
accidents  during  the  period  1969  to  1973(4),  In  these  accidents,  which 
occurred  during  flight  in  IHC  with  instrument  rated  pilots*  the  Safety 
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Board  citad  vacuua  systf^as  or  flight  instruMntt  aa  causal  factors. 

Tha  Safety  board  noted: 

Pilots  oust  he  able  to  detect  prdii|itly  inatruaent 
and  equipaent  aalfunctiona.  A successful  transi* 
tion  froa  routine  IFR  flight  to  an  eaergency  situ- 
ation using  only  a partial  inatcuaent  panel  is 
coapoundsd  if  the  failure  or  aalfunction  is  not 
recognixed  quickly.  ...  If  a pilot  relies  too 
heavily  on  the  pitch  indicator^  he  aay  not 
croascheck  his  other  instruaents  as  frequently 
or  as  efficiantly  as  he  ahould.(4) 

This  heavy  reliance  on  the  attitude  indicator  has  bsen  denonstratad  in 
eye  daell  experiaants  using  exparienced  airline  pilots  during  siuaulated 
xnstruaent  approaches*  Klein  and  Weir  found  that  9QH  of  the  eye  daell 
tiae  aas  devoted  to  the  attitude  and  horizontal  situation  indicators 
during  siaulated  ILS  approaches(^) . if  s.railiar  eye  daell  tiaes  apply 
to  general  aviation  pilots^  then^the  Safety  Board’s  concern  would  seea 
to  be  aell-founded* 

In  an  attaapt  to  deteraine  if  the  problea  is  a severe  one,  a pra- 
liainary  flight  experiaant  was  undertaker,  using  a typical  ganeral  aviation 
airplane  and  a aaarle  of  civilian  md  ailitary  pilots. 


-Method- 

Airplane  A Cessna  172  aas  aodified  by  inserting  a length  of  plastic 
tubing  into  the  vacuua  line  bataaan  the  vacuua  puap  and  the  attitude  and 
directional  gyros.  The  plastic  line  aas  routed  (out  of  sight  of  the  left- 
seat  pilot)  to  a point  beloa  and  behind  the  right -front  seat  pilot.  During 
flight » either  the  safety  pilot  or  the  rear -seat  observer  could  pinch  off 
the  line  and  shut  off  the  vacuua  source  to  the  gyros.  The  vacuua  gauge 
aas  by-passed,  thus  eliminating  this  cue  to  the  subject  pilots*  Tao 
subjects  noticed  this  during  preflight  runups  and  were  told  that  the 
gauge  was  inoperative. 

Subject  Selytion  Host  subjects  were  recruited  froa  a University 
class  in  r light  Test  Engineering  taught  at  Wright -Pat  car  son  ATB.  Addi- 
tional subjects  were  recruited  froa  local  airports.  Table  I shoes  the 
pilots'  experience  and  qualifications*  All  pilots  coapleted  a pre- 
ex  per  i-iantal  questionnaire  and  aere  told  that  the  purpose  of  the  expcri- 
aent  aas  to  neaaure  their  tracking  accuracy  outing  VOR  holding  patterns 
or  VOR  approaches  (as  appropriate  to  the  flight  profile  floan).  All 
subjects  except  one  were  instruaant  qualified.  All  but  one  vote  current 
in  either  civilian  or  ailitary  aircraft. 

Following  the  e>periasnt,  the  subjects  were  told  the  real  purpose  of 
the  experiment.  (Moat  had  guessed  when  the  failure  occurred.)  They  then 
coapleted  a post-experiaont  questionnaire.  Aaonc;  other  quest  ions  ^ this 
questionnaire  asked  for  recency  of  partial  panel  flight  and  if  they  had 
ever  experienced  a siailiar  failure.  None  K the  subjects  had  experienced 
such  a failure  m IMC. 
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Flight  Profiles  Tvo  briefed  profiles  sere  flosn.  One  consisted  of 
a holding  pattern  at  a VOR.  The  other  saa  a VQR  Instruaent  approach  to 
ainiflUM*  The  subjects  sere  given  sufficient  tin  to  becon  coafortable 
before  the  final  task.  All  reportad  that  they  felt  ready  for  a perforaance 
aeaaureaent.  The  failures  introduced  in  the  holding  pattern  sere  all 
started  at  the  point  of  reaching  the  VOR. 

The  subjects  briefed  to  fly  a VOR  approach  sere  instructed  to  call 
minimms  at  the  appropriate  point.  Half  sere  told  to  execute  a aissed 
approacn  (sith  the  vacuua  line  closed  off  at  the  sen  instant).  The  other 
half  aade  a fuU--stop  landing  and  the  vacuua  sas  failed  during  the  taxi 
back.  These  subjects  sere  given  a coaplex  routing  to  folios  during  the 
subsequent  takeoff. 

All  ATC  coaotfiications  sere  siaulated  sith  the  safety  pilot  acting 
as  ATC. 

The  subjects  continued  to  fly  the  prescribed  patterns  until  they 
recognized  the  failure.  If  necessary,  they  sere  told  te  continue  flying 
as  if  they  sere  in  actual  seather  conditions.  Tso  ailitary  pilots  sith 
liaited  experience  sith  vacuua  systeas  had  to  have  the  common  poser 
supply  for  the  attitude  and  directional  gyros  pointed  out. 

Follosing  this,  all  subjects  sere  provided  a no-gyro  radar  steer  by 
Dayton  Approach  Control  to  a VOR  approach  at  a nearby  airport.  All  had 
to  perfora  the  interception  of  finlu.  and  final  tracking  sithout  aid  froa 
ATC. 


Data  All  data  sas  hand  recorded  by  the  safety  pilot  and  the  rear 
seat  observer  sho  sas  carried  on  soae  flights.  The  subject's  saoothBSss 
in  controlling  airspeed,  altitude,  heading,  and  track  sas  evaluated  before 
and  after'zthe  failure.  The  level  of  turbulence  present  and  the  degree  of 
ATC  sorkload  sere  also  reported.  The  safety  pilot  for  all  flights  saa  one 
of  the  authors  (RLN),  sho  is  an  experienced  instrument  instructor  pilot 
sith  1200  hours  of  flight  instruction  experience. 

Also  noted  serethe  tine  to  a failure  indication  on  the  gyro  and  the 
failure  node  itself.  The  mount  of  altitude  lost  and  the  heading  deviations 
during  the  failure  sere  also  noted* 

The  subject's  post-experinent  questionnaire  also  asked  for  his  esti* 
nate  of  the  excursions  during  the  failure. 


-Results- 

In  some  says  the  results  sere  as  predicted.  None  of  the  subjects 
sas  able  to  fly  a consistent  track  over  the  ground.  This  vas  expected. 
However,  none  of  the  subjects  lost  control  of  the  airplane.  In  no  case 
did  a subject  pilot  have  any  difficulty  in  naintaining  vings-level  flight. 
This  is  not  to  say  that  they  flew  within  IFR  tolerances,  but  they  did 
retain  control  of  the  airplane. 
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Tabl*  II  show  th»  extmt  of  oiropood,  oltitudo,  htading,.«id 
track  •xcursions  notod  by  th*  wfoty  pilot  «¥l  by  tho  aubjocts  thoiK 
aelvM  in  U»  poot  experiaant  quaationnaixas.  In  ganaral  tha  track 
oxcursiona  aare  so  bad  that  no  conaiatant  aaaaura  could  ba  uaad  by 
tha  safety  pilot.  Bafora  tha  axpariaant  aaa  floan,  aa  had  dacidad 
that  losing  Z50  ft  aould  ba  conaidarad  *a  loss  of  control."  As 
can  ba  aeon  in  the  table,  only  one  subject  axcaaded  this  figure. 

In  retrospect,  this  criterion  aaa  probably  too  strict. 

Folloaing  detection  of  the  failure,  the  subjects  aera  required 
to  fly  a VQR  approach.  They  aera  alloaad  a no-gyro  vector  to  inter- 
cept the  final  approach  course,  but  they  aera  required  to  intercept 
and  fly  the  final  baaed  aolely  on  their  oan  navigation.  Table  III  show  the 
safety  pilot's  asssssaant  their  aaoothnesa  of  control  both  before 
and  folloaing  the  failure.  The  aaaiothnass  "after. failure"  does  not 
include  the  excursions  during  the  initial  part  of  tha  failure,  just 
tha  flying  "after  settling  dosn."  One  subject,  S3,  had  better  perforat- 
ance  folloaing  the  failure.  This  particular  subject  had  not  been  on 
flying  status  for  mm  tiae  and  aas  probably  still  on  tha.lsaming 
curve.  All  of  tha  other  subjects  did. not  do  as  sell  on  tha  partial 
panel  as  on  tha  full  panel. 

It  is  aorth  noting  tha  different  failure  descriptions.  Tha  holding 
pattern  failures  took  about  six  ainutes  to  develop.  These  usually 
produced  s pitch  up  error.  ^TUat  is,  tha  gyro:shoasd  a pitch  dosn  leading 
the  pilot  to  raise  the  nose.  Tha  directional  gyro  continued  to  run  for 
scan  tins  after  the  attitude  gyro  failed  in  aost  cases. 

During  the  failures  introduced  on  takeoff  or  during  a go-around, 
the  failures  occorred  such  anre  quickly.  In  thaae  cases  the  failure 
nodes  sere  not  at  all  consistent.  The  failure  daacciptions  are  ahoan 
in  Table  IV. 

Table  V show  additional  reaponsss  to  questions  on  tha  post-experi- 
nent  questionnaire.  The  aost  coanon  reply  to  '^d1at  cue  did  you  use  to 
detect  or  notice  the  failure?"  oas  the  attitude  gyro.  Actu^ly,  the 
subjects  reported  that  it  aaa  discrepancies  beteean  this  instruaant 
and  other  instruaants  that  first  alerted  then  to  a problen.  Several 
cited  inconsistent  teaponaes  displayed  on  tha  artificial  horizon ;as 
they  applied  control  inputa. 

The  subjects  did  not  feel  that .control  aaa  especially  difficult 
folloaing  tha  failure.  While  they  aera  sure  that  previous  experience 
did  help  then  to  fly  sith  a partial  panel,  they  aere  auch  less  sure 
about  the  value  of  this  experience  in  detecting  a failure.  The  failed 
gyros'  notion  did  distract  then  during  tha  partial  panel  flight. 

In  general  the  subject  pilots  felt  that  this  aas  a realistic  dsaon- 
stration  of  instrunent  failure.  A nuaber  of  coaaents  suggest  that  it 
aould  be  a useful  addition  to  intial  and  recurrent  instruaent  training. 

These  coaaents  are  ahoan  in  Table  VI. 
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-Canclu«ian»> 

Th»  priMTy  conclusion  is  that  the  probles  of  gsnsrsi  svistion 
pilots  coping  with  vscuua  pump  failures  is  not  as  severe  as  initially 
believed  when  %tm  experiment  ess  designed,  bhile  the  subject  pilots 
eere  reasonably  current , they  had  not  practiced  partial-panel  flight 
for  many  ye*rs  (in  one  case  nineteen  years).  Nevertheless  they  eare 
able  to  fly  the  airplane  safely  and  would  have  made  a safe  recovery 
had  the  weather  been  a 1000  ft  ceiling  with  one  ails  visibility.  In 
spite  of  articles  to  the  contrary  (6)»  the  general  aviation  pilot 
seem  to  be  able  to  cope  with  the  problea.  The  military  pilots  hod 
more  difficulty^  primarily  because  of  a lack  of  familiarity  with  the 
systems. 


It  did  seem  that  the  subjects  had  no  clear-cut  approach  to  flying 
a given  track  on  partial  panel,  however.  They  did  not  attempt  to  fly 
a heading,  but  rather  reacted  simply  to  the  motion  of  the  deviation 
indicator.  It  would  seem  that  this  area  could  be  added  to  initial 
iiistrunent  training. 

We  recommend  that  partial  panel  training  for  initial  instrument 
ratings  bo  improved  to  include  failure  modes  of  the  primary  instruments 
with  si:lisequent  trscking  and  at  least  one  VOR  approach. 
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PILOT  IMOOCED  LONG  PERIOD  OSCILLATIONS  CREATED  BY 
CERTAIN  DISPLAY  CONPIGURAIIONS 

by 

Jaawt  J.  Adams 

NASA  Langlay  Raaaarch  Cantar 
Hampton I Virginia 

Ganaral  aviation  aeeldant  racorda  show  that  tha  moat  daagaroua  parled  of 
an  IFR  flight  la  tha  approach  to  landing.  Ona  araa  of  coneam  In  thia  mattar 
la  tha  rola  that  Inatrumant  display  configurations  play  In  tha  stability  of 
tha  pilot-aircraft  aystam.  Pilot  raaponsa  atudlaa  and  pilot  modallng  affort 
hava  shotm  that  tha  pilot  doas  raspond  much  Ilka  a llnaar  faadback  control 
machanlam  whan  controlling  an  aircraft,  sad  that  a daflnlta  stability  charae- 
tarlatle  doas  raault  la  tha  pilot-aircraft  aystam.  Aircraft  “^ira  daalgaad  so 
that  In  moat  caaas  this  aystam  stability  la  poaltlva  (dampad),  but  occaaloaa 
do  arias  whan  tha  ayatam  bacomas  uastabla.  Pilot  laducad  oscillations 
hava  baan  an  Itam  of  study  for  soma  tlma.  Up  until  now  thaaa  atudlaa  hava 
usually  cantarad  around  abort  parlod  (around  2 to  3 aaeonda)  Instabllltlaa. 

Long  parlod  unstabla  oscillations  can  also  occur.  Involving  larga  dlaplacamanta 
from  tha  daslrad  flight  path  of  tha  aircraft,  which  affact  tha  safaty  of  flight. 
Thara  Is  avldanca  of  such  long  parlod  Instabllltlas  to  ba  found  In  msasuramants 
mada  during  Instnasant  landing  approachas.  Howavar,  thass  Instabllltlas 
usually  do  not  hava  tlam  to  baeoma  wall  davalopad  bafora  tha  pilot  goas  visual, 
and  than  tha  Instability  dlsappaars.  Tha  prasant  study  will  amphaslsa  tha 
axlstanea  of  thaaa  long  parlod  Instabllltlaa  by  apaclal  tast  tachnlquas  mada 
posslbla  by  tha  flaxlblllty  of  tha  simulation  cos^utar,  and  ralata  tham  to 
convantlonal  ganaral  aviation  Inatrumant  display  configurations. 
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DESIGN,  SlMULA'aON  AND  EVALUATION  OF  ADVANCED  DISPLAY  CONCEPTS 
FOR  THE  F-16  ^ONTROL  CONFIGURED  ^”?HICLE 


v-^^^bert  W.  Klein* 

Gc\ldance  and  Control  Department 
Grumman  Aerospace  Corporation 
Bethpage,  N.Y.  117:4 

Walter  H.  Hollister 

Associate  Professor,  Department  of  Aeronautics  and  Astronautics 
Massachusetts  Institute  of  Technology 
Cambridge,  MA  02139 

^research  conducted  at:  Department  of  Aeronautics  and  Astronautics 
Massachusetts  Institute  of  Technology 
Cambridge,  MA  02139 

ABSTRACT 

The  purpose  of  this  study  was  to  design,  simulate  and  evaluate  advanced 
display  concepts  to  augment  the  tracking  ability  of  the  F--16  Control  Configured 
Vehicle  (CCV) . A literature  search  reveals  that  historically  CCV  and  display  re* 
search  has  been  conducted  independently;  the  design  ot  a display  system  for  a 
CCV  aircraft  should  take  the  unique  CCV  flight  modes  (l.e.  direct  force,  point* 
ing,  translation)  into  consideration.  This  paper  de;:ail8  the  recent  M.I.T. 
study  which  reviewed  the  F*16  CCV  fllg}it  test  program,  reviewed  current  air- 
craft display  research,  and  suggests  task*oriented  and  compensatory  displays 
to  even  further  enhance  the  capability  of  the  F*16  CCV* 

The  fixed-base  M.I.T.  707  simulator  was  modified  to  represent  the  F*16 
CCV*  An  Isometric  sldearm  control  stick  and  two* axis  CCV  thumb  button  were 
installed  in  the  cockpit*  The  forward  cockpit  CRT  was  programmed  to  present  an 
external  scene  (numbered  runway,  horl.^on)  and  the  designed  Heads  Up  Display* 

The  cockpit  interior  was  modified  to  represent  ^ fighter  and  the  F*16  CCV 
dynamics  and  direct  lift  and  side  force  modes  were  programmed*  Compensatory 
displays  were  designed  from  mantmachine  considerations* 

Pilots  evaluated  the  Heeds  Up  Display  and  compensatory  displays  during 
simulated  descents  in  the  presence  of  several  levels  of  filtered,  aero*mean 
wind  gusts.  During  a descent  from  2500  feet  to  the  runway,  the  pilots  tracked 
a point  on  the  nu*way  utilizing  the  basic  F*16,  F*16  CCV,  and  F*16  CCV  with 
advanced  displays.  Substantial  tracking  improvements  resulted  utilizing  the 
CCV  mode3,  and  the  displays  were  found  to  even  further  enhance  the  tracking 
ability  of  the  F-i6  CCV. 

INTRODUCTION 

Thi  F*16  Control  Configured  Vehicle 

The  F*16  CCV  was  selected  for  the  M.I.T*  study  based  on  the  operational 
timeframe  of  the  aircraft,  recent  flight  test  and  evaluation  by  USAF  pilots, 
and  availability  of  aircraft  dynamics  data.  In  1973  the  Air  Force  Fll^t 
Dynamics  Laboratory  contracted  with  General  Dynamics  for  an  87  fli^t,  125 
hour  teat  program  of  the  F*16  CCV  (ref.  1).  This  marked  the  first  exploita- 
tion of  decoupled  six  degree-of- freedom  flight  path  control.  Completed  in 
June  1977,  Edwards  Air  Force  Base  teat  pilots  evaluated  the  CCV  control  modes 
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Figure  I.  Heads  Up  Display 


•Mill 


durlnt  the 


for  air-to-air  md  alr-to-gromd  slsaloda.  Kacoaaaadatiooa  Mda 
fllgtit  taat  program  ata  lucorporatad  In  tha  M.I.T.  dlaplay. 

Rafarancaa  2»3,  and  4 datall  cha  F-I6  CCV  program.  Hodlflcatlons  to  tha 
F-lh  includa  cantad  canards  on  tha  forward  fusalaga  and  ■odlflcatlon  of  tha 
flight  control  aystaa  (FCS)  to  iaplanant  tha  diract  forca»  pointing  and  troas- 
lation  nodas.  The  trim  button  on  tha  aldaarn  controllar  was  raplacad  with  a 
two-axis,  forca-oparatad  thuah  button.  Thus  in  tha  diract  forca  nods,  laft 
thunb  pressure  on  tha  thunb  button  ccanands  a left  flat  turn  rata.  Upward 
thuab  pressure  coMsads  diract  lift.  In  tha  diract  forca  nods*  prasaura  on  tha 
thunb  button  coMsn^s  tha  rata  of  changa  of  horlsontal  and  aartical  flight  path 
angla.  "Baaplng**  tha  thuab  button  incranants  tha  flight  path  angle  for  snail 
tracking  corrections.  Tha  CCV  node  (diract  force*  pointing*  translation)  is 
selected  on  tha  cockpit  control  panel  and  cowanded  by  tha  thunb  button.  Mote 
that  the  pilot  does  not  nova  his  hands  or  feet  fron  the  conventional  controls 
to  utilize  the  CCV  nodes;  they  do  not  disturb  normal  aircraft  operation  and 
augnant  the  fighter  capability. 

During  the  flight  test  program*  g\n  canara  filns  quantitatively  recorded 
tracking  performance  and  qualitative  pilot  coMents  were  recorded.  Tha  pilots 
reconmended  higher  atthority  nodes  (3  g*s  or  greater).  They  noteo  that  the 
flight  path  angle  could  be  driven  laterally  without  banking*  eliminating  the 
'*pendulua  effect'*  with  the  fixed  ractlcle  sight.  Since  tha  COV  aircraft  effec- 
tively decouples  the  aircraft  attitude  and  velocity  vectors*  attitude  was  no 
longer  a cue  for  the  aircraft's  instantaneous  destination.  A Heads  Up  Display 
(HCD)  presentation  of  the  velocity  vector  was  recoHsnded  to  restore  the  atti- 
tude: velocity  vector  cue.  Many  of  the  modes  enhanced  fighter  operations  in 
air-to-air  and  air-to-ground  tasks  (ref.  3). 

Advanced  Dijplays 

.he  decision  to  choose  a Heads  Up  Display  (HUD)  to  augment  the  OCV  aircraft 
operation  foUo^-s  from  analysis  of  the  CCV  aircraft/mode  controller /pilot  inter- 
face. Tha  flight  regimes  in  which  the  CCV  modes  will  isqirove  fighter  perfor- 
mance is  in  air-to-air  coebat*  air-co-ground  weapons  delivery  and  landing  in 
variable  weather  conditions.  In  all  these  missions  tha  pilot's  attention  is  fo- 
cussed outside  tha  aircraft  at  another  aircraft*  a gromd  target*  or  the  naiway* 
The  Heads  Up  Display  sllows  tha  pilot  to  keep  his  attention  oriented  outside 
the  canopy  with  his  eyas  focussed  at  infinity.  The  msasurad  and  displayed  flight 
information  appears  in  one-to-one  correspondence  with  the  outside  world.  A HUD 
presentation  of  tha  velowlty  vector  ovarlayed  on  the  external  scene  restores 
cha  lost  attitude: velocity  vector  faedbacx  and  inproves  perception  of  the  air- 
craft flight  path.  These  reasons  strategically  point  tc  the  utilisation  of  a 
Heads  Up  Display  to  fully  realise  CCV  mode  potential. 

Figure  1 illustrates  how  a Heads  Up  Display  operates.  By  projecting  fli^t 
information  through  a lens  on  a half  silvered  mirror  oriented  Inside  the  canopy* 
the  pilot  simultaneously  views  the  outside  world  and  flight  data  focussed  at  in- 
finity. De.iys  are  eliminated  in  continually  refocussing  from  the  heads  down 
instruments  to  the  exteinal  scene.  The  sheer  distance  and  associated  delay  time 
in  scanning  from  one  instv'ument  to  another  is  signifigantly  reduced  since  most 
of  the  relevant  flight  information  is  integrated  on  the  HUD  display. 

Figure  2 shows  how  the  flight  Information  and  outside  scene  appears  through 
the  HUD.  The  primary  information  a HUD  should  display  is  the  flight  vector*  the 
horizon  and  the  intended  tiack  or  target  superimposed  on  the  external  scene. 

Other  information  which  can  be  displayed  is  an  aircraft  attitude  symbol*  rsfer- 
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ence  angle-of-attAck,  limit  aaglc-of-attack  (stall)  sad  potsntlsl  path  (aircraft 
path  in  accelerated  flight).  The  potential  path  is  used  for  dirust  aanageaBat. 
Uhen  the  syabol  is  above  the  velocity  vector  excels  thrust  exists  and  when  the 
syebols  coincide  velocity  is  stabilized.  When  the  velocity  vector  is  above  the 
horizon  the  aircraft  is  dishing  and  «fhen  below  the  horizon  it  is  losing  alti- 
tude. Uhen  sysbolic  flight  data  is  in  one-to-one  correspondence  angularly  with 
the  outside  view*  aircraft  states  are  nore  easily  interpreted  and  controlled. 


For  exanple»  if  the  velocity  vector,  horizon,  and  aircraft  body  axis  are 
displayed  on  the  HUD,  the  following  angles  are  readily  apparent: 


Heading  ^ 

Sideslip  0 
Angle-of-attack  ()( 
FUghc  Path  Aasla  ^ 
Plcch  Angla  Q 


Figure  3.  Angular  Data  Perceptible  fron  HUD  Synbology 

Flight  information  (such  as  velocity  V,  vertical  velocity  S)  can  be  visually 
deduced  fron  angular  relationships  between  the  velocity  vector,  body  axis  and 
horizon  overlayed  on  the  real  world.  The  pilot  nay  steer  the  velocity  vector 
cowards  an  intended  destination  point.  Any  cross  wind  or  wind  gradient  (shear) 
is  iMediately  apparent  since  the  background  scene  will  drift  with  respect  to 
the  velocity  vector.  Isnediate  realization  of  these  situations  allow  the  pilot 
to  nake  appropriate  corrective  control  actions. 


In  general,  a pilot  can  nenitor  seven  to  eight  data  items  without  diffi- 
culty, according  to  research  carried  out  by  the  loyal  Aircraft  Establishment, 
Famborough.  England.  Thus  the  display  should  be  designed  to  show  only  those 
Instrument  readings  necessary  for  a given  mode  of  flight.  The  highest  priority 
data  should  be  close  to  the  nominal  field  of  view  to  reduce  scan  lag.  Infer* 
nation  should  be  displayed  in  the  appropriate  analog  (compensatory)  or  digital 
(maerical)  form  to  minimize  pilot  workload.  Large  eye  movesmnts  should  be 
minimized,  and  the  display  axes  should  physically  correspond  with  the  outside 
world  (i.e.  altitude  along  vertical  axis,  heading  angle  along  the  horizontal 
axis,  etc.)  In  "natural  display  directions"  (as  viewed  from  the  aircraft  out- 
ward). It  is  also  advantageous  to  have  the  altitude,  airspeed,  etc.  informa- 
tion located  in  the  normal  "T"  dashboard  panel  positions  (airspeed  upper  left, 
altitude  upper  right,  etc.)  for  crew  transition  to  the  HUD  display.  The  near- 
ness of  data  to  the  nominal  point  of  view  and  its  priority  should  follow  a 
gaussian  distribution  (the  most  frequently  scanned  displays  closest).  Display- 
ing information  in  the  appropriate  analog  tape  form  or  digital  form  should  min- 
imite  Interpretive  and  com>ensatory  workload.  The  HUD  field  of  view  must  be 
w enough  so  that  velocity,  heading,  and  altitude  may  be  peripherally  dis- 
px.yed  without  interfering  with  target  acquisition.  Since  angular  relationships 
are  preserved  on  the  HUD,  and  the  gUD  is  nominally  located  19"  from  the  pilot's 
eyes,  a 10"  HUD  screen  yields  a 30  field  of  view.  This  is  appropriate  for  the 
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^ 3^  pointing  authority  (a  10^  authority  square  in  a 30^  by  30^  field)  and  the 
angle*of-*attack  variation  fron  high  to  low  speed. 

DISPLAY  DESIGH  FOR  THE  CCV  AIRCRAFT 

In  designing  an  appropriate  display  to  augment  CCV  aircraft  perfonance 
one  nuat  consider  the  display  as  part  of  the  total  pilot /controller/aircraft 
closed  loop  system  (figure  4).  In  conventional  aircraft • the  pilot  wust  utilize 
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Figure  4.  Tne  Display  System  as  part  of  the  Total  Pilot /Aircraft  System 

several  controls  in  a closed  loop  fashion  to  bring  about  a coManded  state. 

The  pilot  adjusts  his  internal  transfer  function  to  effectively  decouple  the 
coupled  system.  In  general,  the  himun  is  not  particularly  efficient  in  decoup- 
ling multiple  degrees-of-freedom  systems.  Such  systems  increase  the  workload 
and  cuigiensation  a pilot  must  provide  in  bringing  about  a desired  state.  For 
instance,  in  making  a heading  change,  the  pilot  utilizes  the  aileron,  rudder 
and  elevator  to  initiate  the  bank,  to.  bank,  and  return  to  wings  level  fli^t 
once  the  desired  heading  change  is  achieved.  The  aircraft  is  strongly  coupled 
lateral-directiooally.  The  pilot  must  apply  ''lead**  or  anticipate  when  to  roll 
out  of  the  bank.  The  decoupling  and  lead  the  pilot  must  apply  correspond  to  an 
increase  in  concentration  during  the  maneuver  and  thus  an  increase  in  pilot 
workload. 

Harem  lies  the  advantage  of  the  CCV  aircraft.  One  control  nay  be  utilized 
to  coanand  one  state.  In  the  above  example,  the  CCV  pilot  could  Just  ’*beep** 
a heading  angle  change  using  the  direct  side  force  mode  The  rate  of  change 
of  heading  Is  proportional  to  the  lateral  thuab  force  or  * "Coolie  Hat"  thob 
button.  The  response  is  decoupled,  and  the  heading  chat  ^ easily  conducted, 
since  the  heading  angle  change  is  proportional  to  one  inpu^  (single  input: 
single  output  relationship).  A similar  analogy  may  be  made  with  the  sluggish 
phugoid  mode  which  is  controlled  by  thrust  and  elevator  setting.  The  direct 
lift  mode  quickens  the  phugoid  response  and  coMands  the  flight  path  angle. 

In  designing  a display  for  the  CCV  aircraft  one  notes  that  there  are  al- 
ready i.eatures  of  conventional  displays  which  augment  CCV  performance*  The 
conventional  system  of  crosshairs  serves  as  an  aid  in  compensatory  tracking  or 
nulling  the  diagonal  offset  of  a target.  If  one  crosshair  axis  is  met,  the 
human  controller  knows  to  translate  purely  along  that  axis  (figure  5).  The 
CCV  slew  rate  responses  to  horizontal  and  vertical  thuab  button  inputs  are 
parallel  to  the  crosshairs.  In  this  way  CCV  display  design  has  been  reduced 
to  human  compensatory  engineering  analysis. 

In  nulling  the  pointing  error  the  display  should  improve  CCV  performance 
if  it  displays  aircraft  slew  rate  magnitude  and  direction.  These  are  sensed 
on  the  thuab  controller  (slew  rate  is  proportional  to  force  on  thuab  controller) 
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Figure  5.  Nuliliig  Offsets  Uclllsiog  Aircraft  Crosshair  Systea 

but  tha  authors  bellasa  that  fores  sagnltude  and  asgls  are  not  ssnssd  accurate* 
ly  enough  hy  the  thunb.  A prorsr  display  of  CCV  slew  races  and  dirsctloii  of 
slew  would  augnent  CCV  perforasnee  In  air-to-air  and  air-to-ground  tracking. 

One  possibility  is  a vector  display  (figure  6)  which  shows  the  na^iituds  and 


Figure  6.  Vector  Conpensatory  Display  S'lowing  CCV  Magnitude  and  Direction 

direction  of  the  slew  rate.  The  himsn  controller,  visualising  the  actual  slew 
rate  nagnitude  and  direction,  can  change  the  force  and  direction  exerted  on  the 
thiari)  controller  to  null  the  pointing  error.  The  overall  CCV  tracking  capability 
should  inprove  since  the  display  applies  an  additional  nore  accurate  feedback 
to  the  pilot  than  the  force  feedback  fron  the  thueb  controller. 

If  there  is  concern  that  the  arrow  will  interfere  with  target  acquisition, 
another  display  could  be  a line  showing  the  angular  direction  of  the  thtab  force 
exerted  on  the  '’Coolie  Hat"  (figure  7).  Angular  data,  rather  than  nagnitude 
data,  is  presented  since  the  thunb  probably  senses  force  level  better  than  force 
direction,  and  thus  it  is  force  direction  data  that  is  incorporated  in  the  dis- 
play. 


Figure  7.  Angular  Conpensatory  Fomat  and  CCV  Mode  Activation 
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Another  ftature  which  should  be  iacorporsted  la  ait  authority  circle.  With 
equal  poiotlag  capability  la  pitch  and  yaw,  the  circle  illuat rates  the  region  ia 
which  CCV  point  lag  Bv>des  3&ay  be  utlllzedii  Ko  guesswork  Is  necessary:  once  cne 
pilot  acquires  the  target  vlthta  the  authority  circle,  he  may  utillie  the  quick, 
decoupled  CCV  oodes  toz  precise  aiatlng.  Thus  for  the  pointing  node,  there  are 
two  candidate  compensatory  formats  ^figures  6 and  7). 


Similar  caagnitude  and  direction  Information  could  be  displayed  for  the 
direct  force  and  translation  modes  or  accede  rat  Ion,  vector  length  and 

direction  Indicates  magnitude  and  direction  of  acceleration,  maxiBBum  vector 
length  Inside  the  authority  circle  corresponds  to  maalmum  CCV  acceleration)  • 

The  nominal  velocity  vector  circle  would  serve  as  the  ^'ector  origin  vith  a dead- 

figure  6 or  7 could  be  used  for  coi»- 
f pointing  or  trao  slat  Iona  1 CCV  mode. 


band  for  small  force  inputs.  Thus  either 
pensatory  tasks  involving  the  direct  force 
depending  on  which  mode  was  presently  in  operation. 

The  next  step  is  the  display  of  numerical  flight  data.  This  Includes  air- 
speed, heading  angle,  altitude,  Mach  nuiober,  and  rate-of-cllmh/slok.  Tape  seale^ 
of  airspeed  will  be  displayed  a) eng  the  left  border,  heading  along  the  fop,  and 
altitude  along  the  right  border.  The  analog  ”tape^*  foiv:  Is  chosen  since  this 
Is  compensatory  data  and  pilot  workload  Is  lover  nullxng  tape  errors  rather  than 
reading  a digital  format.  Interpreting  the  data  sn^o  making  an  appropriate  control 
action  (rate  information  is  lacking  In  the  digital  format).  Digital  values  of 
Hach  number  and  rate-of-climb/s£nk  are  displayed  In  boxes.  In  this  case  the 
ni*>erlcal  values  are  of  most  interest  -\n  artificial  horizon  la  also  included 
In  this  Integrated  display.  Bas«»d  on  the  alive  analysis  of  CCV  operation  and 
advanced  displays,  the  cand'^date  Heads  Up  Displays  In  figures  S and  9 are  pro- 


Figure  h.  Candidate  neads  Up  Dlsplav  with  Compensatory  Display 
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Flgurt  S*  Ciiiidtdate  Heads  Up  Display  with  Compensatory  Display  {Angular) 
COifVIHSION  OF  m 707  SIMRATOK  TO  THE  F--16  CCV 

In  order  to  evaiuiate  these  concepts  an  existing  707  slawlacor  {figure  L0> 
vaa  converted  to  an  F-16  CCV  simulator  vlth  an  advanced  Heads  Up  Display.  Ex- 
tensive modificatlona  vere  made  to  the  assembly  language  program®  to  accomm^ace 
the  F-16  aircraft  dynmaica^  The  Heads  Up  Displays  shown  In  figures  8 and  9 were 
prograwaed.  A numbered  runway  and  horlxon  line  was  added  to  represent  Che  ex- 
temei  scene  during  the  flight  simulation.  The  external  scene  enhanced  the 
fidelity  of  the  slBailatton  by  providing  aircraft  posit IwaaX  perspective  with  re- 
spect to  the  nmway  and  attitude  cues.  The  cochplt  Interior  was  modified  to  rep- 
resent a fighter  and  isometric  sldeatm  controller  (as  currently  utilised  on  the 
F-16)  with  CCV  Isometric  thumb  button  was  Installed  In  the  right  half  of  the 
cockpit.  Figure  11  outllnea  the  operation  of  the  simulator.  The  simulator  pilots 
viewing  the  HUD  and  external  «cene,  operates  the  controls  (sticky  CCV  button* 
throttle,  etc.)  to  bring  about  a change  In  aircraft  states.  These  mechanical 
Inputs  are  converted  to  electrical  analog  signals  which  are  then  sampled  by  an 
analog: digital  converter,  signals  are  demultiplexed  Into  appropriate  channels 

for  the  assembly  language  programs.  The  Adage  ACT- 30  cotnputer  calculates  the 
aircraft  states  and  updates  the  HUD  and  external  scene  CFT  display.  An  update 
occurs  every  1/20  second  with  no  perceptible  flicker.  The  previous  707  simulator 
is  the  product  of  ten  years  of  research  at 

A random,  lero-mean  wind  gust  program  was  written  to  study  tracking  perfor- 
mance In  the  presence  of  gusts  and  turbulcnre.  The  gusts  were  realistically 
generated  hv  filtering  Gausalan  white  noise  with  the  Dry den  spectra  wind  model. 

The  RMS  aopiltude  of  the  wind  was  set  for  three  discrete  levels  during  the  test 
prograux, 

v7rl  gin  ally  the  compensatory  displays  were  to  Indicate  just  the  CCV  input. 

This  yielded  somewhat  encouraging  tracking  Improvements.  The  decision  was  made 
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to  have  the  coapenaatory  displays  represent  the  vector  sue  of  the  direct  force 
■odes  (thuBb  button  Input)  and  wind  effects  upon  the  aircraft.  Thus  the  arrov 
and  line  represent  the  Inertial  aircraft  acceleration.  The  displays  therefore 
serve  teo  purposes.  By  shoving  acceleration  they  provide  lead  to  the  pilot  in 
the  tracking  task.  The  displays  also  provide  an  additional  visual  cue  to  the 
pilot  so  when  a sudden  gust  affects  the  aircraft  the  pilot  nay  respond  laBsdl- 
ately.  The  arrov  represents  the  future  position  (In  3/10  second)  of  the  velo- 
city vector  circle  with  respect  to  the  external  scene,  and  aids  the  pilot  vith 
or  without  wind. 


TEST  PBDOAM 

The  purpose  of  the  test  prograa  was  to  utilize  the  F-16  CCV  slnulator  to 
determine  whether  the  CCV  nodes  do  Isprove  tracking  performance  over  the  con- 
ventional aircraft  fll^t  modes  and  If  the  designed  compensatory  displays  do 
indeed  augment  CCV  tracking  performance.  A tracking  task  vas  programed  Into 
the  F-16  CCV  simulator:  tracking  the  aircraft  velocity  vector  over  the  runway 
numbers.  A program  vas  written  to  determine  the  average  tracking  error  (RMS) 
In  degrees  x 1000.  Figure  12  shows  the  instantaneous  error  ERRT  which  Is  ave- 


^feoary 


Figure  12.  Diagram  Showing  Tracking  Error  Measure 

raged  over  time  (samplings  occur  every  1/20  second).  The  performance  index  or 
average  RMS  tracking  error  Is 


A run  consists  of  tracking  the  velocity  vector  over  the  middle  of  the  runway  num^ 
bars  during  a descent  from  2500  feet  to  sea  level.  At  the  end  of  each  run  the 
average  RMS  tracking  error  vas  recorded*  Three  runs  totalling  6 minutes  were 
made  for  each  configuration  (sampling  time  1/20  second) . 

The  four  configurations  of  Interest  were  the  basic  F-16,  F-16  CCV,  and  F-16 
CCV  with  each  of  the  conpenaatory  displays.  Three  runs  were  conducted  for  each 
configuration,  in  the  pr^ence  of  no  wind,  moderate  winds  (6.6  kts  RMS,  peak  gust 
18  kts)  and  severe  winds  (13.2  kts  RMS,  peak  gust  37  kts).  The  pilots  flew  the 
basic  aircraft,  CCV  aircraft,  and  CCV  aircraft  with  compensatory  displays  in  the 
presence  of  various  wind  levels  for  approximately  45  minutes  for  famlllarlzatloa 
with  the  aircraft  dynamics  to  minimize  any  bias  during  the  testing  due  to  learning. 
The  tests  themselves  were  conducted  in  several  different  orders  to  minimize 
learning  curve  bias. 
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WIND 

CONFIGURATION 

No  Wind 

Basic  F-16 

F-16  CCV 

6.6  kts  RMS 

Basic  F-16 

F-16  CCV 

F-16  CCV  w/  Display  1 

F-16  CCV  w/  Display  2 

13.2  kt*  RMS 

Basic  F-16 

F-16  CCV 

F-16  CCV  w/  Display  1 

F-16  CCV  w/  Display  2 

Table  !•  Test  Run  Hetrlx 


Table  1 shows  the  test  run  matrix.  Displays  1 and  2 were  not  tested  for 
the  no  wind  case  since  inputs  do  not  exceed  the  deadband  of  the  compensatory 
display.  The  pilots  were  not  aware  of  their  tracking  performance  until  all  the 
runs  in  the  entire  test  matrix  were  completed.  No  affective  comments  (positive 
or  negative)  were  made  to  the  pilots  to  influence  performance.  Before  quantita- 
tive tracking  results  were  revealed,  subjective  comments  %rere  recorded  and  past 
fll^t  experience  outlined.  The  quantitative  and  qualitative  results  are  given 
in  the  next  section.  The  pilots  did  not  have  to  adjust  trim  or  thrust  and  there- 
fore just  utilised  the  stick  and  CCV  thumb  button  during  the  conduction  of  the 
testa.  The  pilots  were  instructed  that  they  would  be  rated  purely  on  how  well 
they  tracked  the  velocity  vector  circle  over  the  runway  numbers.  The  pilots  were 
alone  In  the  simulator  during  the  tests  of  various  configurations  and  wind  levels* 
Most  of  the  pilots  had  combat  experience  in  fighters. 

SIMOLATION  RESULTS 

The  results  of  the  test  program  are  given  in  table  2.  One  notes  the. sub- 
stantial Improvement  in  tracking  performance  with  CCV  modes,  and  signlflgant 
Increase  in  performance  with  the  designed  displays*  Table  2 shows  the  percent 
improvement  with  CCV  modes  over  the  basic  aircraft  and  percent  Improvement  of 
the  F-16  CCV  tracking  with  the  advanced  displays  for  each  pilot.  An  approximate- 
ly 40Z  Improvement  in  tracking  ability  with  the  direct  force  modes  compares 
favorably  with  gun  camera  films  recorded  during  the  Edwards  Air  Force  Base 
flight  test  program. 

A 10-15Z  reduction  in  pointing  error  is  observed  when  the  advanced  displays 
are  incorporated  in  the  F-16  CCV  simulation.  There  Is  little  difference  ( 1 
standard  deviation^  5Z)  in  performance  Improvement  between  the  tiro  displays. 
Display  2 gives  angular  predictor  information  (both  displays  represent  the  sum 
of  wind  effects  and  CCV  inputs)  and  display  1 gives  magnitude  as  well  as  angular 
information.  Since  there  is  little  difference  between  the  two  displays  magni- 
tude information  in  ^his  case  did  not  augment  performance.  This  supports  the 
earlier  hypothesis  that  the  thumb  can  sense  magnitude  information  but  cannot 
sense  angular  information  well  on  Che  CCV  button.  It  is  the  additional  visual 
feedback  of  direction  that  die  pilot  uses  to  improve  his  tracking  performance 
10-15Z.  It  is  this  predictor  or  lead  cue  the  display  gives  of  where  the  velo- 
city vector  circle  will  be  superimposed  in  the  next  3/10  second  which  augments 
the  piIot:CCV  aircraft  system. 
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CONFIGURATION  AND  « 
PERCENT  IMPROVEMENT 

|g| 

PILOT 

2 

rgm 

iiSBl 

MEAN 

STidIDARD 

DEVIATION 

■mssmsi 

SSI 

NO  WIND 

CCV  over  Basic  F-16 

20.0 

57.7 

23.7 

55.6 

48.5 

43.8 

41.6 

14.5 

WIND-6.6  kts  RMS 

47.9 

63.5 

54.8 

15.1 

36.7 

30.9 

41.5 

16.0 

CCV  over  Basic  F-16 

F-16  CCV  w/  Display  1 

■B 

18.7 

12.4 

18.7 

11.8 

9.3 

13.0 

4.44 

F-16  CCV  w/  Display  2 

■B 

15.5 

15.2 

19,4 

13.0 

10.5 

Gffl 

3.77 

WIND-13.2  kts  RMS 
CCV  over  Basic  F-16 

15.5 

52.4 

50.3 

O 

22.8 

36.0 

30.0 

18.0 

F-16  CCV  w/  bispUy  1 

2.5 

20.4 

Ba 

15.9 

7,8 

■B 

IB 

6.29 

F-16  CCV  w/  Display  2 

12.6 

fsa 

ggj 

4,8 

■g 

9.8j 

|11.7] 

5.08 

Table  2.  Sunnary  of  Tracking  Improvements  with  CCV  Moflea  over  the  Basic  F-16 
for  Various  Wind  Levels  (Random,  ZerO'-Mean  Gusts)  and  Summary  of  Im- 
provement in  CCV  Tracking  Performance  with  Compensatory  Displays 
(Percentage) 

CONCLUSIONS 

Based  on  the  test  program  utilizing  the  fixed-base  F-16  CCV  simulator  with 
F-16  CCV  dynamics,  a Heads  Up  Display  with  an  external  view  of  a numbered  run- 
way and  horizon,  an  isometric  sldearm  stick  with  two-axis  thumb  button  to  com- 
mand the  direct  force  modes,  and  a modified  cockpit  interior,  the  following 
conclusions  were  reached. 

1.  In  the  presence  of  no  wind  to  moderate  winds  (6.6  kta  RMS),  the  six  pilots 
utilized  the  direct  force  modes  to  Improve  RMS  tracking  ability  40Z  over 
that  attained  with  the  basic  aircraft. 

2.  In  the  presence  of  sever  winds  (13.2  kts  RMS),  the  direct  force  modes  im- 
proved tracking  ability  approximately  30Z.  The  dectease  from  (1)  is  prob- 
ably due  to  the  fact  that  large  CCV  inputs  are  necessary  in  severe  winds, 
which  cause  manual  force  coupling  problems  between  the  thumb  button  and 
sldearm  stick. 

3.  The  designed  displays  improved  the  tracking  capability  of  the  F-16  CCV 
10-1 5X. 

4.  Subjectively  most  pilots  preferred  the  arrow  display  (display  1)  over  the 
angular  dl  play  (display  2);  the  latter  was  found  to  be  more  distracting. 

5.  Observing  the  tracking  resc'^ts,  there  was  no  statistically  signifigant 
difference  between  the  two  ^^j^splays.  The  angular  display  gave  predictor 
Information  for  direction.  The  arrow  display  gave  magnitude  and  direction 
information.  Thus  the  pilot  primarily  used  direction  information  to  im- 
prove his  tracking  performance;  the  additional  magnitude  information  did 
not  Improve  his  performance  appreciably.  This  correlates  with  the  devel- 


Improvements  in  tracking  performance  with  displays  1 and  2 are  referenced  to 
the  F-16  CCV  without  the  compensatory  displays 
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opea  hypo  thesis  that  the  thumb  could  sense  the  magnitude  of  the  CCV  input  Weil 
^ut  not  its  direction.  The  purpose  cf  the  display  was  to  show  the  direction  of 
the  input » which  it  did.  Thus  the  magnitude  cue  was  already  .ivailable  from 
thumb  button;  the  direction  is  now  available  from  the  display. 
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The  coacepc  of  a cocltplt  display  of  traffic  infor«atloa  (CDTI) 
Includes  the  Integration  of  al?  traffic,  navigation,  terrain  and 
weather  Information  In  a single  electronic  display  In  ttie  coc*«^plt* 
The  pr'^sert  study  was  conducted  as  part  of  a research  project 
designed  to  'levelop  a clear  and  concise  display  format  for  use  In 
later  full  alsslon  slmul^*!oc  evaluation  of  the  CDTI  concept.  This 
experlasnt  required  airline  pilots  to  monitor  a CDTI  and  make  per* 
ceptual  judgments  conc'  'tg  the  future  position  of  a single 
Intruder  aircraft  r .nshlp  to  their  own  aircraft  (ownshlp). 

The  main  experimental  variable  was  the  type  of  predictor  used  to 
display  future  position  of  each  aircraft.  Predictors  were  refer* 
enced  to  the  ground  or  to  ownshlp  ^nu  they  either  1 icluded  turn 
rate  Information  or  did  not.  Other  variables  were  the  aircraft's 
sep£*^atlon  distance  when  the  judgment  was  lequlred  and  the  type  of 
encounter  (stra  or  turning).  Results  Indicate  that  under  chess 

experimental  conditions  fewer  errors  were  made  when  the  oredlctor 
Included  turn  rate  Information.  There  was  little  difference  in 
overall  error  rate  for  the  curved  ground  referenced  and  the  ownshlp 
refe' enced  predictors. 


INTRODUCTION 

Projected  estlmstes  of  air  traffic  indicate  e marked  Increase 
In  congestion  occurring  over  the  next  20  years.  This  Increase  Is 
expected  to  ersate  a demand  for  greatly  improved  air  traffic  con* 
troL  services  to  maintain  lmp«*ove  present  levels  of  safety. 
Relevant  to  the  area  of  safety  are  concerns  dealing  with  efficiency 
of  flights  li«co  and  out  of  capacity  limited  terminal  areas.  The 
concept  of  a cockpit  display  o*  traffic  Information  (CDTI)  Is 
presently  being  considered  to  determine  Its  rolR*  In  the  air  traffic 
system. 

The  CDTI  is  displayed  on  a cathode-ray  cube  (CRT)  located  in 
the  aircraft  cockpit  with  a display  created  by  a computer.  The 
display  allows  the  pilot  to  see  other  aircraft's  position  In  rela* 
tion  to  the  pilot's  own  aircraft.  The  pilot's  own  position  end 
directl  n of  travel  with  respect  to  eves  navigation  routes  and  ter* 
rain  features  are  Indlc  ited  by  e headlng*up  moving  map. 

Prior  experiments  in  this  project  were  dli  .cted  toward 
developing  a clea:  easy  to  use  display  (lef.  I,  2,  3,  4), 

Questions  roncernir.g  chr  genr-^lc  w3Tl  display  were  directed  toward 
the  display  symbolcgy  and  factors  affecting  perception  of  motion, 
r.tich  variables  as  update  r«.te  lewlng  time,  background  and  methods 
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of  dltplaylQg  past  and  future  position  of  the  aircraft  have  been 
considered.  Additional  studies  have  been  aade  on  hoi#  to  display 
vertical  situation  infornation  on  a nap  display  (ref.  5,  6). 

The  object  of  this  experinent  was  to  evaluate  different  pred- 
ictors of  aircraft  notion  in  the  horizontal  plane.  Four  predictors 
were  used.  These  were  either  ground  referenced  or  ownshlp  refer- 
enced with  or  without  turn  rate  infornation.  Also  of  interest  was 
whe  er  there  was  «.  difference  in  learning  with  the  different  pred- 
ic  Curs • 


^lETHOD 

Subjects . Sixteen  airline  pilots  were  paid  to  participate  in 
this  experinent.  Mo  pilot  had  prior  experience  using  CDTt  synbol- 
ogy»  ellainating  the  possibility  of  previous  learning  affecting  the 
results . 

Apparatus . The  pilots  were  seated  in  a two-place,  fixed-base 
transport  slnulacor.  The  only  functioning  parts  of  the  simulator 
were  the  CRTs  chat  displayed  the  traffic  information.  Responses 
were  made  on  a hand-held  instrument. 

Visual  display.  The  CDTI  was  displayed  on  a 18  cm  X 18  cm 
CRT.  The  center  of  the  scree.'i  was  located  25  deg.  rad)  below 

Cue  horizontal  on  the  pilot's  center  line  sad  .87  m from  the 
subject's  eye  reference  poin^.  The  width  of  the  terrain  displayed 
on  the  CRT  was  10  nautical  miles  (18.5  hm).  With  this  mao  ;*cale,  I 
nautical  mile  (1.85  km)  or  tae  ground  equals  1.2  cm  on  the  display. 
The  ownshlp  was  represented  by  a chevron  symbol  with  the  exact 
location  of  ownshlp  being  the  top  point  of  the  symbol.  The 
intruder  was  represented  on  the  display  by  a circular  symbol  with  a 
dot  in  the  center  indicating  its  present  location.  Roth  ownshlp 
and  intruder  were  displayed  with  ground  referenced  history  dots. 
Bach  of  the  eight  dots  indicated  the  past  position  of  the  aircraft 
over  the  ground  at  4 sec  intervals.  These  symbols  were  preferred 
by  most  pilots  in  Hart's  studies  of  pilot  preference  for  various 
types  of  COTI  symbols  (ref  7,8).  An  area  navigation  route  map 
provided  ground  objects  for  the  background. 

Encounter  variables . There  were  48  different  encounters, 
figure  I shows  48  encounters.  For  example,  encounter  I 

alsplays  the  ownshlp  in  a heading  up  position*  The  intruder  is 
approaching  from  the  right*  In  Figure  I all  sketches  show  rurved 
ground  referenced  predictors  for  the  purpose  of  illustration.  in 
24  of  the  encounters  the  intruder  ultimately  passed  in  front  of 
ownshlp.  In  the  remaining  24  the  intruder  ultimately  passed  behind 
the  ownshlp.  In  24  of  the  encounters,  both  i'rcraft  went  straight 
and  in  the  remaining  24  cne  or  both  aircraft  turned.  In  24 
encounters  ::he  display  stepped  at  44  sec  to  the  point  of  closest 
encounter.  The  remaining  24  encounters  stopped  at  28  sec  tr  the 
point  of  the  closest  encounter.  The  parameters  for  the  encounters 
are  found  in  Palmer  ec.  al. 

Constant  encounter  -arametars  ncluded:  vlawlng  time,  8 sec, 
separation  distance  at  encounter,  3J00  ft  (.91  km),  and  update 
rates  for  ownshlp  and  intrudar,  Ownship's  position  and  heading  was 
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upi'iCsd  every  1 sec. 

Display  V j r t jb las . Thera  were  four  coailclons  of  ilsplay 
preilccars:  (t)  scritfht  ^rouni  refereaced,  (b)  curved  ground 
refcrancai,  (c)  straight  relsttve*  lal  (4)  curved  relaclve.  lo  tha 
scral^hc  ground  rcfereaced  pradiccors*  the  end  of  tha  vector  Indl- 
cited  the  projected  position  of  the  aircraft  over  the  ground  In  32 
sec,  issunln;  the  aircraft  vslntained  Its  current  Instantineous 
‘ground  track.  The  curved  ground  referenced  predictor  Indicated  the 
position  of  the  aircraft  In  32  sec,  assusln^  the  aircraft  ealn* 
tilned  its  current  turn  rate.  In  curved  oncounters  this  predictor 
carved  In  proportion  to  the  turn  rate.  With  the  straight  relative 
predictor  the  end  of  the  predictor  indicated  tha  intruder's  posi* 
tion  relative  to  tha  own ship  position,  direction,  and  speed  If  both 
aircraft  salntaln  their  current  ground  track.  With  the  curved 
relative  tha  end  of  the  predictor  predicts  the  position  of  the 
intruder  relative  to  ownshlp  if  both  aircraft  maintain  their 
current  turn  rates.  In  encounters  where  both  aircraft  are  ^oin^ 
scral'^ht  *^he  display  appears  the  sane  with  hoth  straight  and  curved 
predictors.  Figure  2 shows  the  sane  encounter  with  each  of  tha 
four  predictors.  Mo  radar  noise  or  tracker  la^  were  siaulated. 


quality 


intruder's  position  and  heading  wa^ 


SnUlQHT  OnOUNOWICFERCNCEO  RELATIVC  PREDICTOR  ON 
PREDICTORS  ON  BOTH  AIR-CRAFT  INTRUDER  AND  NO  PREDICTOR 

(STR  QRPI  ON  OWN  SHIP  (STR  OPR) 


CURVED  OROUNO-REFERENCEO 
PREDICTORS  ON  BOTH  AIRCRAFT 
(CRV  QRP) 


CURVED  RELATIVE  PREDICTOR 
ON  INTRUDER  AND  NO 
PREDICTOR  ON  OWN  SHIP 
(CRVORP) 


Figure  ? , 


The  four  display  formats  used 


in  the  esperiuent. 
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P roceg  Cl* . Tna  for  this  5tp<5rl»senc  wss  to  'tooltor  th^ 

COTl  fo^r  T soc  -lal  predict  %#hethsr  the  Intruder  aircraft  i^ould 
ulrla.itely  piss  In  front  of  or  In  bach  of  the  ownshlp.  The  sub- 
jects Inllcatei  their  decisions  by  pressing  the  ipproprlite  button 
on  the  hinl  held  response  svltch*  Tuo  seconds  after  the  Initiation 
of  ths  run,  the  Intruder  ippeired  on  the  COTl  with  i position, 
velocity,  trick  in^le,  ml  turn  rate  cilculitei  so  that  the 
Intruder  ultimately  passed  cither  directly  In  front  of  or  In  bach 
of  ownshlp  In  52  or  5S  sec.  After  3 sec  of  vle^ln^  time  the  CRT 
yis  blin'i^d  ml  rcplicad  ^Ith  a message  ashing  whether  the  Intruder 
would  pass  in  front  or  In  bach  of  ownshlp.  The  pilot  responded. 

The  words  *IM  FRONT**  or  **IN  R\CR"  then  appeared  on  the  screen  Indi- 
cating the  correct  Ju dgaent  • 

Four  subjects  were  assigned  to  each  of  ths  four  conditions. 
Initial  oral  Instructions  concerning  the  concept  of  the  COTl  and 
the  -leaning  of  the  various  display  symbols  were  given.  After 
approximately  one  half  hour  of  training,  all  pilots  underwent  a 
pretest  block  of  A8  encounters  with  no  predictors*  At  the  conclu- 
sion of  the  pretest  trial  there  was  a lO-mlnute  breah.  The  pilots 
received  additional  training  specific  to  the  experimental  condi- 
tion* On  Day  I,  three  blocks  of  the  experimental  condition  of  the 
53  encounters  were  administered  with  a lO-«lnute  break  between 
blocks.  On  Oiy  2,  the  subjects  received  Instructions  on  the  mean- 
ing of  the  COTl  syabols  for  the  experimental  condition  and  three 
more  blocks  of  53  encounters  of  the  experimental  condition  were 
given.  The  experiment  concluded  with  a posttest  block  Identical  to 
the  pretest  block  with  no  predictors.  Presentation  order  was  ran- 
domized. tn  addition,  whether  ths  subject  saw  i specific  encounter 
or  Its  alrro-  Image  was  also  randomized. 

Results 

Table  I shows  the  percent  erro.  for  each  of  the  predictor  con- 
ditions for  straight  and  curved  encounters  at  both  distances.  It 
can  be  seen  In  Figure  3 and  Table  I chat  fewer  errors  were  made  on 
carvel  encounters  when  cha  predictor  Indicated  ths  future  joint 
effect  of  curceat  turn  race  of  both  aircraft.  Roth  ground  refer- 
enced and  ownshlp  referenced  predictors  resulted  in  equally  good 
performances  on  straight  encounters.  However  ths  error  rate  on 
curved  sneountars  was  consistently  lower  for  ths  conditions  with 
curved  gro«‘.nd  or  own  ship  referenced  predictors  that  provided  turn 
rate  Information.  With  tura  rate  Information  ths  error  rate  on  ths 
curved  cncountora  was  comparable  to  the  error  rate  on  straight 
encounters.  The  highest  error  rates  occured  when  both  aircraft 
were  turning  and  thi  predictors  did  not  Include  turn  rate  Informa- 
t Ion . 


An  analysis  of  variance  wis  conducted  on  transformed  percent 
error  me  over  the  four  predictor  conditions,  separation  dist«nre 
at  encounter  and  type  ui  encounter  (straight  or  turning).  Table  2 
sh:^ws  ths  results  of  ths  ANOVA.  Performances  over  the  four  predic- 
tor tyocs,  two  separoclon  dls^’ances  and  encounter  types  were  signi- 
ficantly dlff'^ient  as  were  rus  Interactions  of  predictor  type  and 
separation  distance  and  tb.:  Interaction  between  predictor  type  and 
encounter  type* 
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f reiistort  Cacoatttors 

Scrat^tit  Citrvad 


29 

41  sec 

28 

44  sec 

Moae  Cpreteet) 

3t 

42 

23 

35 

Mone  Cposttest) 

23 

29 

25 

35 

Straight  ground  ref. 

1 

11 

27 

30 

Curved  ground  ref. 

2 

to 

2 

7 

Strilght  owashlp  ref. 

1 

8 

14 

35 

Curved  owashlp  ref. 

0 

0 

0 

10 

Tablt  i.  Perctat  error  averagei  over  sebjeccs  aad  repllcecloas 
for  scralght  lad  carved  eacoancers.  There  were  9S  crlala  each 
per  cell  for  the  precesc  aad  poaccesc  ao  predictor  coadlcloae  ead 
2S9  crlils  each  per  cell  for  the  four  predictor  coadlttoas. 


Source 

5S 

df 

ns 

P 

? 

3215.5 

3 

1071.8 

20.2  * 

0 

1605.3 

1 

1606.3 

178.3  • 

E 

1557.2 

1 

1557.2 

75.6  ♦ 

P X 0 

13.2 

3 

4.4 

<1 

P X s 

1292.6 

3 

430.8 

20.9  • 

0 X B 

2.6 

1 

2.5 

<1 

P X 0 X B 

293.2 

3 

99.4 

5.5  • 

* pO.Ol 

Table  2.  AX0?4  over  predictor  roadlctoae  (P),  separatton  dletaace 
(0),  aad  easouater  type  (T). 
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Flturs  \ sho«a  pmtc%nt  arror  collaF**^  avar  sttbjtets  for  ooeh 
of  tha  ^roilecoro.  Tho  iota  mro  abowo  for  oach  of  tho  roi^lieatlooo 
avora^oi  ovar  tho  too  dlataocoa*  It  eao  bo  aoaii  that  roplleatlooo 
olth  proiictora  io  aot  laproro  parforaaoco  on  tho  ao  proiictor 
poattoat#  Thoro  oaa  no  aitoiflcaot  iifforooco  botoooo  tho  protoat 
aai  poattoat  ooaoa*  Thoro  via  oaliooco  for  loaroiog  for  all  prai* 
letora  oacopt  tho  curvod  ovnahlp  toforoncod  proiictor  ohieh  oaio** 
talood  an  avorage  orror  rato  of  3Z. 

kt  tho  cooelttoioo  of  tho  oaporiooot  tho  pllota  ooro  alloooi  to 
oloo  tho  othor  proiictor  coodltloaa.  Tholr  proiictor  proforooco 
tfoa  roguoatoi.  ill  pllota  proforroi  proiictora  vith  taro  cato 
ioforoatlofi  ioelaioi*  Tho  proforooco  oaa  ooooly  iioiioi  botitooo 
froaoi  roforoocoi  aod  owoahip  roforooeoi  proiictora« 

DISCUSSION 

Tho  oaio  objoctioo  of  thia  ooporioaot  oaa  to  iovoatigato  por« 
foroaocoa  oaiog  iifforoot  typoa  of  proiictora*  Eoiiooco  cloorly 
ahooa  that  tha  aiiicion  of  a proiictor  rodueoi  tho  orror  rata*  Tho 
porcaot  orrc*^  oaa  farther  roiocoi  ohoo  torn  rato  ioforoatioo  aaa 
aiioi  to  tho  proiictor* 

Thoro  atill  rooaioa  a qooatioo  ohathor  groiaoi  roforooclos  or 
oooahip  roforooclos  ia  tho  boat  oothoi*  Tho  poreont  orror  data  oo 
tho  roplieatiooa  ahowoi  that  thoro  oaa  lit**lo  loaming  oith  tho 
curroi  ovnahlp  roforoocoi  proiictor*  ilthoogh  aftor  ait  roplica* 
tiooa  both  currod  ground  roforoocoi  and  curroi  ovnahlp  roforoocoi 
proiictor  coaditlona  had  aloiliar  lov  orror  ratoa* 

Tho  guoation  of  vhich  oothoi  of  roforoncing  ia  boat  ia  furthor 
clouioi  by  tho  fact  that  501  of  tho  orror  vith  tho  curvai  ovnahlp 
roforoocoi  proiictor  vaa  accountoi  for  by  tvo  oncountora*  Thoao 
tvo  oncountora  (III  and  #19)  aro  both  oncountora  vhoro.  tho  ovnahlp 
la  turning*  Thua  tho  curroi  ovnehip  roforoocoi  proiictor  condition 
hoi  a oory  lov  orarall  orror  rato  vhon  thoao  tvo  oncountora  aro  not 
conaiio/ai«  Ono  could  arguo  that  ovnahlp  roforoncing  ia  tho  boat 
oothoi*  Oo  tho  othor  hand*  tho  curroi  ground  roforoncod  proiictor 
condition  had  a noro  aron  diatribution  of  orror*  Ono  nuat  alao 
quoation  how  good  a roforoncing  nothod  ia  if  it  can  bo  ao  confuaing 
on  tvo  of  tha  ancountara  and  not  confuaing  on  all  tho  othor 
ancountara* 

goaults  froo  tho  aubjoctira  data  auggaat  that  tha  nathod  of 
rafaroncing  is  «n  indiridual  prafaronco  and  not  baaoi  on  parfor* 
oanca  * 


COSCLUStON 

Thia  orparlnant  adds  to  a aarloa  of  aaporinanto  dosignod  to 
avaluata  CDTI  display  symbology  in  a dynamic  but  controllad 
anrltonmant*  Tha  folloving  «ra  ganaral  obaarrationa  baaoi  on  tho 
data  from  this  axparlmont.  1)  Tha  addition  of  pradlctlra  informa- 
tion radttcaa  orror*  2)  Tho  boat  raaulta  vara  obtalnad  vhan  turn 
I'ta  information  vaa  includoi  in  cha  pradiction* 

It  is  important  that  any  conclusion  tha  raador  nay  drav  from 
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ch2$3  results  ctke  into  sccouet  the  follo'in)  llittatlons  of  the 
research  not hoi:  (1)  The  pilots  couli  device  their  unlnterruptoi 
attention  to  the  tssk  for  ) sec;  (2)  neither  iLrcrift  chingei  Its 
spoei  or  tu*'n  rate  during  an  encounter;  (1)  although  the  display 
uis  iynasle,  the  pilots  could  not  Interact  ulth  the  llspliy  to  ish 
for  more  Inforiation  about  the  Intruder  or  change  the  map  scale; 

(^)  pilots  could  not  tike  over  manual  control  of  the  aircraft;  (5) 
the  passive  nature  of  the  tash  and  the  large  number  of  trials 
resultol  lii  \ task  that  quickly  became  routine.  The  first  two 
items  should  lead  to  f ewe r errors  than  would  be  expected  In  a real 
aircraft.  The  last  three  items  should  lead  to  more  errors  than  in 
a real  aircraft.  It  Is  felt»  however^  that  the  relative  dlfferanca 
between  the  displays  will  remain  the  same  as  the  task  Is  made  more 
rosllstlc. 
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abstract  ^ 

The  class  of  systems  of  interest  is  that  in  which  an  operator  is 
faced  with  a continuous  control  task  plus  one  or  more  discrete  infor- 
mation processing  tasks.  The  objective  is  to  explore  a modelling  approach 
which  has  the  capability  of  realistically  representing  both  types  of 
tasks  and  the  resulting  interactions.  The  modelling  approach  utilizes 
discrete  network  models  for  the  cognitive  tasks  and  elonents  of  an 
open-loop /closed-loop  control  representation  for  the  continuous  task. 

The  approach  is  demonstrated  through  its  application  to  a simulated 
Digital  Avionics  Information  System  in  which  subjects  were  required  to 
perform  retrieval  and  processing  tasks  as  well  as  flight  control.  This 
model  differs  from  conventional  models  in  that  system  status  sampling  fs 
not  necessarily  continuous  or  periodic.  Rather ^ the  pilot  is  assumed 
to  read  system  status  displays  only  as  time  permits  and  operate  in  a 
so-called  V en-loop**  preprogrammed  fashion  between  sampling. 

TNTRnniimnN 

It  is  clear  to  anyone  participating  in  this  conference  that  research 
on  supervisory  control  has  been  increasing  during  the  last  few  years, 
rhis  study,  which  was  primarily  exploratory  and  methodological  in  scope, 
fol'*  48  in  that  trend  and  the  results  contribute  to  a better  under- 
standing of  human -machine  systems  and  supervisory  control  modelling. 

Specifically,  a computer  simulation  approach,  which. utilizes 
discrete  network  techniques  to  represent  certain  cognitive  and  decision 
making  tasks  and  a novel  control  model  for  continuous  tasks,  was  used  to 
explore  a number  supervisory  control  questions.  A rather  general 
simulation  model  of  operator  performance  with  a digital  avionics  infor- 
mation .lystem  (DAIS)  was  constructed  and  verified  against  data  which  had 
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been  collected  in  a previous  man«>in-the*loop  study.  * l^e  resulting 
model  was  used  to  perform  sensitivity  analyses  of  flight  control  variables 
and  explore  a variety  of  questions  about  task  organisation  and  performance 
strategy.  An  outline  of  the  model  and  some  of  the  more  interesting  results 
are  reported  here. 

It  must  also  be  mentioned  that  in  addition  to  the  above  traditional 
modelling  objectives*  a major  reason  for  the  study  vas  to  explore  the 
possible  utilisation  of  digital  simulation  methods  for  the  design  of 
expensive  aan*>in-the-loop  type  experiments.  A fev  suggestions  toward 
this  end  are  also  presented. 

DESCRIPTIQH  QF  THE  DAIS  S^:5nJVTQB 

The  DAIS  simulator  cockpit  replaced  many  of  the  traditionally  dedica* 
ted  instruments*  displays*  and  subsystem  controls  with  interactive  multi-- 
purpose  displays  (MPO)  and  multifunction  keyboard  switching  (NFK).  The 
mock-up  cockpit  had  a forward  station  configured  simular  to  a single- 
engine* single-place,  transonic  light  attack  aircraft,  ^e  front  panel 
of  the  cockpit  was  equipped  with  three  CRT-type  displays*  two  served  multi- 
porpose  functions  and  the  center  display  was  used  to  present  information 
concerning  basic  flight  parameters  in  a moving  tape  format.  The  flight 
control  display  presented  c*irrent  readouts  of  the  aircraft  angle  of 
attack*  g-load*  indicated  airspeed*  percent  of  total  throttle,  mach 
number*  vertical  velocity*  and  heading.  Information  storage  and  retrieval 
was  achieved  through  the  use  of  the  multi -function  keyboard  and  the 
alphanumeric  keyboard  located  on  the  left  side  of  the  cockpit.  The 
cockpit  also  contained  a throttle  with  afterburner  switch  and  a center- 
mounted  Joystick  control  i^ch  were  used*  in  combination  %rlth  the  dis- 
played flight  information*  to  **fly"  various  maneuvers.  Analog  outputs 
from  the  stick*  throttle*  and  MFK  were  processed  by  an  A/D  converter 
for  input  to  a digital  computer  where  further  processing  was  performed. 

The  nonlinear  aircraft  motion  equations  were  simulated  digitally  and 
updated  to  respond  to  the  positions  of  the  stick  and  the  throttle.  Simi- 
larly, switching  instructions  comrunicated  to  the  pilot  via  audio  headsets 
wer^  entered  through  the  MFK  causing  the  MPDs  to  be  updated.  i 

Flight  control  variables  were  recorded  in  terms  of  the  error  between 
the  actual  values  and  the  command  or  desired  levels.  Performance  scores 
were  computed  for  both  the  flight  control  alone  and  flight  control 
performed  in  conjunction  with  MFK  switching  configurations  of  the  mission. 

These  scores  along  with  data  collected  concerning  discrete  information 
retrieval  task  times  were  used  to  compare  and  evaluate  the  information 
workload  tradeoff  of  the  proposed  DAIS  system. 

This  system  was  selected  for  this  study  for  several  reasons;  (l) 
it  appeared  to  b:^  representative  of  many  contemporary  - ine  systesu 

in  that  it  required  monitoring  and  discrete  information  prv  .4sing  beha- 
viors as  well  as  motor  control  tasks*  (2)  preliminary  performance 
estimates  were  available*  and  (3)  results  of  this  endeavor  had  implications 
for  ongoing  research  and  experimental  studies. 


ORIGINAL  PAGE  IS 
OF  POOR  QUALITY 


DESCRIPTIOH  OF  EXPERIMEMT  AMD  PBQCEDURES 

Seven  different  maneuvers  were  employed  in  the  flight  control  task* 
They  are  identified  in  terms  of  command  flight  pp.rameters  ?s  defined  in 
Table  1. 


TABLE  1 

BASEU:«E  FLIGHT  CONTROL  MANEUVERS 


Maneuver 

1 - straight  and  level 

2 - left  turn 

3 - right  turn 

U - turning  dive 

5 - stall 

6 - turnii^  a&cent 
T - high-g  turn 


Altitude 

Velocity 

(ft) 

(kt) 

20,000 

500 

30,000 

500 

30,000 

500 

— 

500 

20,000 

240 

— 

500 

30,000 

6oo 

Vertical 

Velocity 

(ft/mln) 

G-Load 

0 

1.0 

0 

1.5 

0 

1-5 

-2500 

1.5 

0 

1.0 

2500 

1.5 

0 

3.0 

The  subjects  were  instructed  to  **aaintain**  these  parameters  ^oi  the 
duration  of  the  mission  (approximately  200  secs.)*  Flight  control  was 
scored  as  a function  of  the  difference  between  the  desired  control 
parameters  and  thi^  actual  ones.  These  '*deita^*  ( A ) values  were  computed 
every  200  milliseconds.  The  flight  parameters  on  which  scoring  was 
based  was  chosen  through  consultation  with  pilots  and  other  researchers 
who  were  able  to  specify  on  an  experiential  basis  the  minimum  number  of 
S4.gnificant  parameters  for  each  mission,  and  the  importance  of  a given 
amount  of  error  in  each  parameter.  Working  from  this  basis,  a fonula 
was  derived  for  each  maneuver.  The  specific  formulas  chosen  for  the 
maneuvers  used  in  this  study  are  presented  in  Table  2. 

TABIi;  2 

PERFORMANCE  SCORES 

( .01)  ^ altitude  (.1)  A speed 
(.005)  vertical  velocity  ♦ (.1) 
speed 

( .005) A vertical  velocity  + (*1)A 
speed  '('Ag-load 

(.  01 ) A altitude  (.1)  A speed  (1.1) 

g-load 

NOTE:  A represents  the  mean  absolute  error  from  the  command  vaxue. 

Four  levels  of  task  difficulty  were  utilized  for  the  HFK  switching 
tasks,  which  required  approximately  U,  6,  8 or  12  push-button  switch 
actions  per  task.  The  KFK  task  was  scored  on  basis  of  correct 
completion  of  the  switching  sequence,  total  time  required  fo'*  correct 
completion,  nd  time  per  switch  action. 


MANEUVER 

Straight  and  Level  Flying 
Dive/ClUb 

Diving/ Climbing  Turn 
Level  Turn 
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ThrM  diffftrrat  coafigurations  vert  coaeidtred:  flight  coatrol 

alone,  NFK  alone,  and  the  coabination  o:  tlifht  coatrol  vith  tvltchins* 

Four  collife  students  served  as  subjects  for  the  experlaeats.  Each 
received  approiciaately  ^0  hours  of  traialof  on  he  priaarF  flight  control 
task  and  at  least  20  hours  of  training  on  both  the  secondazy  MFK  and 
combined  tasks*  In  every  case,  training  vas  to  asymptotic  performance* 

In  the  fll^i^  control  alone  segment,  there  vere  26  trials  per 
subject  - four  for  each  of  the  seven  maneuvers*  At  the  usginning  of  e 
trial  the  subjeot  vas  told  vhieh  maneuver  he  vas  to  xly,  including  the 
flight  parameter  val.ies  to  be  maintained*  Then  he  vas  allowed  to  "fly** 
the  timulated  aircraft  until  he  vas  confident  he  vas  prepar  - to  start 
the  maneuver,  vhieh  he  indicated  by  pulling  r trigger  on  U jotrol  stick, 
designated  as  the  **hotsvitch'*.  At  that  point  a 200-»second  trial  began 
vith  automatic  scoring  and  termination  by  the  supporting  computer  prO'«:*am. 
There  vere  30-seeoad  intervals  betveen  trie  Is* 

task  alone,  each  subject  vas  also  given  28  200-second 
trials*  There  vere  seven  trials  for  each  of  the  four  levels  of  MFK  ^ 
difficulty  Investigated*  Thirty-second  rest  intervals  separated  trials* 
/our  different  m tasks  of  the  given  difficulty  level  vere  performed 
during  each  trial  period.  The  subject  received  pre-recorded  instructions 
via  bis  earphones  concerning  the  task  hs  vas  to  psrfiozm*  Ths  instructions 
vere  followed  by  • tone  i^ch  vas  ths  signs!  to  stsrt  ths  MFK  task* 

Ths  suhjset  dsprevsed  s ’*stop'*  button  on  the  left  side  par  I to  the 
right  and  ahead  of  the  throttle,  to  indicate  he  bad  completed  the  Hn 
trmk*  The  experimenter  monitored  the  duplicate  displtys  at  his  station 
to  aacsrtain  ths  corrsctnsss  of  subjsct  action  on  tbs  MFK* 

Ths  combinsd  flipht  coatrol  vith\MFK  ssssion  vas  idsntiesl  to  the 
flight  control  single  tssk  condition  except  as  follovs*  Thirty  sscoads 
after  ths  subject's  signal  that  be  vas  reddy  for  scoring  of  ths  flight 
maneuver  to  start,  tbs  recorlsd  instructions  for  ths  first  MFK  task 
vers  presented*  ^us  ths  flight  control  end  IR  single  task  scenarios 
vers  ”o/erlsyed"  so  ths\;  each  subject  bad  to  divide  V^a  attention 
betveen  them  throughout  the  standard  26  200-second  trial  periods*  The  * 
subjects  vere  instructed  to  give  first  priority  to  flight  control*  A 
more  detailed  description  of  the  pro^rdures  xan  be  found  in  references 
1 and  2* 

raimTIfKT)  KTMBTATTOJ  MODEL  aTRUOm 

Tvo  basic  maneuver  types  out  of  the  seven  employed  in  the  DAIS 
real-time  simulation  vere  slx'ilated:  straight  and  Itvsl  flying  and 

a turning  dive.  Chese  are  con  idered  to  be  the  easiest  and  hardest 
flight  maneuvers,  respectively*  An  open-loop  closed-loop  control  vodel 
for  these  maneuvers  based  on  the  flight  equations  employed  in  the  DAIS 
simulation  vas  developed*  Conventional  control  models,  in  vhieh  the  pilot 
is  sssuBsd  to  be  sampling  system  status  Tsrlab''  cont5.nuously  (or 
periodiesUy  in  the  discre*^e  time  case).,  are  t«zmed  "closed-loop"  models* 
The  proposed  model  differs  from  that  r.bove  in  that  syxttm  sVtus  sampling 
is  not  nreessarlly  continuous  nor  periodic,  due  to  the  secondazy  multi- 
function keyboard  tasks  imposed  upon  ^ae  pilot.  Therefore,  thn  pilot 
reads  ^ system  status  displsys  onl?  as  time  permits  and  g aerates  In  m 
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$o*c«XXed  *’opeii*Ioop'*  preprogramed  ftahioo  between  saapllng. 

Figure  I deplete  the  structure  of  tbe  open-loop  closed-^loop  control 
systen.  Tbe  pilot  nust  encode  and  process  Inforaatlon  from  flight 
control  displays,  nUtipurpoae  displays,  and  exogenous  events  such  as 
audio  svitching  Instructions.  Tbe  |ilot  then  evaluates  this  inform- 
tion  as  a function  of  systen  status  denands,  applying  decision  rules 
and  priority  requirenents  in  deteminiag  his  selected  output  control 
or  svitching  actions.  Sons  of  these  actions  involve  conscious  decision- 
ashing  on  the  part  of  the  pilot;  others  are  highly  devel<9ed  p^rcho- 
notor  dhills  requ^xed  for  llight  control  iavolvtag  less  conscious  decision- 
ashing. 

The  operator  is  p^ fOmiag  in  a nnlti-tash  envirocment  at  sev^ol 
different  behavioral  levels.  Be  is  nonltoriag  displays,  processing 
Inforaation,  ashing  flight  control  inputs,  sad  storing  sad  retrievi^ 
iafonstioa  via  tbe  heyboard  svitchl^  tashs.  It  is  tbe  nodeXliag 
o«.  these  activities,  along  vltb  tbe  pilot's  cognitive,  deeision-nahlng 
processes,  to  idiich  tbe  nodels  presented  herein  are  addressed. 

The  decision  nahing  process  and  tbe  iafomatioa  syatan,  including 
the  sniltifuactioa  svitching  tashs,  are  nodelcd  via  discrete  netiiorh 
techniques.  Because  of  the  hierar^iical  structure  of  aetvortc  nodels, 
tbe  tash  activities  of  tbe  pilot  nay  nov  be  represented  at  may 
different  levels.  For  exsnple,  tashs  nay  be  used  to  indicate  discrete 
btttton^usbing  sad  dial  setting  aperations.  They  any  also  be  ehployed 
In  representing  sequential  and/or  stochastic  iaformtion  processing 
nodels.  Ou  a completely  differ*nt  level,  netuoric  nodels  are  used  here 
to  achieve  desired  state  variable  smpli^  intervals  sad  priority 
sebenes.  Tbs  netvorh  structure  is  designed  to  operats  at  asny 
different  levels  simltaneously  snd  tins  is  enable  of  representing 
sophisticated  mn^e chine  systen  behaviors.  In  its  ^plication  here, 
tbe  netvorh  also  serves  a supervisory  role  in  interfacing  vith  the 
open-loop  optinal  control  nodei  representation  of  the  pilot's  traching 
tash.  These  tvo  nodeling  approaches  are  nsshed  together  to  fom  s 
cenbined  discrete  netvortc-conticnous  optteal  control  nodei  of  the  • 
hman  operator. 

CUatroi  Hadil 

The  open  loop-closed  loop  nodei  is  best  described  In  linear  systens 
term.  In  tbe  case  vbere  tbe  operator  is  assuned  to  be  sanpling  continu- 
ously, Lis  control  beharior  is  represented  as  a anltivariate  proportional 
plus  incegral  control  systm  operating  on  a noise  corn^ted  displayed 
er^or  inpet.  The  open  loop-closed  loop  fomulation  presunes  that  control 
responses  batveen  sanples  cf  state  variables  are  based  on  s conditional 
neao  extrepolation  of  tbe  systen  trajectory.  The  effect  of  sailing  is 
to  redefine  or  update  tbe  state  of  tbe  extrapolation  nechanisn.  The 
control  response  then  is  essentially  continuous  altbou^  tbe  ssnpling  snd 
Inform tion  processing  required  is  discontinuous. 

The  nodei  is  most  easily  described  in  a closed  loop  fom  first  and 
then  extended  to  the  open  loop-closed  loop  version.  The  operator's 
response  is  presuned  to  be  proportional  plus  integral  and  defined  by  a 
systen  of  the  foUoving  fom: 
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i(t)  • K (*(t)  ♦ u(t))  U) 

U(t)  • K(t)  ♦ 0(t(t)  ♦ U(  ))  ♦ ltt(  ) (2) 

whvr*  U(t)  is  tbs  CMtrol  vsctor  (fors-sn  stick  Bevsamt»  si4s-ci4s 
stick  aossMbt.  tbrottls);  t(t)  is  tbs  4yaiale  portios  of  tbs  vootrel, 
tdso  s tbrss  OinsBsionsi  vsctor;  K(t)  is  o six  4iM«»loasl  error  sector 
rsprsssotioc  tbs  desist  loo  fro*  AooiasX  ssi»isa  of  tbs  ststs  ssrlshlss 
(sltito4s,  roll  si^is.  bssdisc  ta^ls,  fU^bt  pstb  004X0.  004X0  of  sttsck, 
ssXocityli  U\t)  is  s 4isfXs9r  f**ki04  error  sector  sstsae4  to  be  shits 
ooissi  so4  ls(T)  is  s ootor  ooiss  tom  sXso  ssssas4  to  be  shits  ooiso. 
this  04s rotor  oodsi  Is  bored  00  k Xioosritsd  ssbicXs  ao4sl  of  tbs  foco: 

ii%i  • AKt)  ♦ W(t)  ♦ Ss(ti  (3) 

shore  S(t)  sad  0(t)  ore  so  4sfioo4  sboso,  oo4  ts(t)  is  s process  miss 
sector  osssBOd  to  be  shits  ooiss.  Tbs  Xlasoriss4  ao4sX  (setooXX^  tso 
ao4sXs.  00s  for  soch  osossssr)  sos  sss4  to  4sflos  tbs  cootrol  ihibs  C 
so4  S sis  optiasX  cootrol.  lo  tom  of  tbs  operator  ao4sHi04  problsa 
s^uotloa  (3)  should  be  slsssd  as  so  lotsraol  aodsX  so4  it  is  oot  idootlcoX 
to  tbs  ooo»llosor  s^iiMtloas  used  to  siauXots  tbs  aircraft. 

Tbs  OMO  Xoop-cXossd  loop  oodel  coo  aow  be  dsfioed.  t^Mtloos  (X). 
(2)  sod  (3)  for*  a stochastic  process  dsocrlbiod  tbs  rsopooss  process 
ttet  tbs  operator  sooXd  Uhs  to  rsaXiss.  Xa  auvwoted  fom  this  process 
is  dsscribod  bf: 


shlcb  for  coossoieocs  or  ootatioo  is  rssrltteo  as 

X(t)  • Ax(t)  e F»(t)  t^) 

shore 

X(t)  -T*(t)l 

lz(t)J 

lot«  that 

«(t)  ^ X(t)  ♦[010]  Kt).  (5) 

Per,  to  obtais  tbs  opes  Xo^<<Xoss4  Xoop  fons.  1st 
T(t)  • U 0)  X(t)  ♦ U(t)  (6) 

rsprsssot  tbs  displox  readisp  process  sad  dsfiss 

M(t,T)  ♦ s(x(t)/trn).  ^T. 

N(t,T)  la  tbs  coaditiooaX  asas  of  tbs  process  based  00  a sai^Xs 
r(t)  at  tiac  T - CXsarlp, 

jaLtT)  • A»(t.T),  ''T) 

dt 

sad  uodsr  tbs  assuaptioa  that  there  is  so  mmorj  or  iofensstlos  procsss- 
104  associated  sitb  the  aeBpUs4  process 

M(t,r)  • 

Tht  ap«r%tor*t  control  roo^ooto  1»  ootvMd  to  ^ of  tho  fotm 
U(t)  • (Q  t]  H(t,T)  ♦ ®s(t)  (9) 
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which  is  bMlcaiXy  (5)  ^th  th«  eooditloa«l  •••■  «ib«titht4# 

for  X(t)  «Bd  the  display  error  roBorod* 


FIOJRE  Z 

state  VAftlABLC  SAHPLZH6 

Iqostioa  (9)  producos  a ■OBSohst  diseoatiauotts  or  opisodie  eootroX 
rospoaso  duo  to  tho  rosottiac  of  the  aeoa  at  saapla  poiats*  A Iqrpe* 
thatical  rospoaso  ciroa  saaploa  at  tiaas  ^ » H • * . is  shoaa  la 
flcara  2 (dram  with  tba  asanaptloa  that  is  error  free). 

Ihe  iataraatad  reader  is  rafarrad  to  Siafart^  for  aora  dataiXs  oa 
tha  BodaX  daeaXnfaant  aad  davalopBOatt  of  tha  covarlaaee  propartiaa. 

Basaliae  aodal  paraBatars  for  each  Baaaavar  (coaftrol  palas  aad 
noise  statistics)  aare  obtalaad  XarjfaXy  ty  trial  aad  error  gaidad  hgr 
aathods  aad  data  foaad  ia  tba  aaaaa V eoatroX  Xitaratara*  laltial^eoatrol 
gaias  vara  astiBsted  usiag  stata  variable  asairaloa  liBlt  aathods  to 
postulate  a quadratic  regulator  optiaal  eoatrol  problea.  These  para- 
eaters  vara  then  adjusted  to  produce  acceptable  Bodal  parfomaBca  (tha 
Bodel  "flev**  too  vail  vith  tha  iaitial  astiaatas).  loisa  parenetara  vara 
estiaatad  frcB  sigaal  to  aoisa  eoasidaratiooa  of  the  DdXS  data* 

The  overall  Bodal*  ^cludiag  the  aatvork  structure  for  discrete  tasks, 
vas  iaplaaaotad  ia  SAIVT^, 

ergiT.Ta 

Tha  results  coosist  of  saasitivity  analyses  of  tha  baseliae  BOdal 
sad  SOBS  aora  exploratory  snaXyais  of  altamativa  task  ^tratagias. 

A series  of  nodal  runs  ware  aade  la  a coofiguratioa  ia  which  all 
state  variables  ware  sanpled  every  a tlm  units*  The  assuaptios  is  that 
the  sulti-fuaetioa  switching  tasks  do  not  interfere  vith  the  flight 
control  variable  saapling.  The  flight  control  display  variable  sanpling 
interval  was  varied  over  a range  of  1.  to  10*  seconds  for  straight  aad 
level,  aad  -5  to  2*  seconds  for  turning  dive.  The  resulting  overall  score 
for  t^ee  different  initial  randOB  nuBber  seeds  are  displayed  in  Tables 
,3  and  b.  fiach  raadon  nmbar  seed  corresponds  to  a new  saaple  fron  the 
tnsenble  of  aissioa  scores.  A graphical  representation  of  tha  first  data 
appears  in  Figure  3.  The  three  synbols  displayed  ia  tha  graph  denote 
the  three  different  ssnples  taken  at  that  saaple  interval.  Of  sone 
laportaaee  is  the  sensitivity  of  the  scores  to  tha  saapling  interval . In 
the  straight  and  level  naaeuver  the  scores  appear  to  ba  increasing  alaost 
linearly  vith  the  saaple  interval,  vith  the  exception  of  the  b,5  aad  5.0 
tine  Intervals.  At  5.  the  score  Juaps  drsaatioally  to  *69*  This  would 
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not  be  so  surprising  except  that  at  a time  Interval  of  6,  seconds,  tnc 
score  drops  dovn  to  a range  between  .35  end  It  gradually  increases 

for  the  7.  and  10.  second  sampling  intervals. 

A similar  phenomenon  occurs  in  the  turning  dive  case.  Between  .5 
and  .8  the  score  is  relatively  insensitive  to  the  sample  interval.  At 
1.0  the  score  Juqps  to  dlmost  10.  Again,  at  higher  sample  intervals 
the  scores  drop  down;  at  1.6  the  score  ranges  between  3.6  and  5-98. 

Like  the  straight  and  level  case,  the  scores  begin  increasing,  this 
time  not  quite  so  gradually. 

These  peaks  in  the  scores  at  .5  in  straight  and  leve,  and  1.0  in 
turning  dive,  were  not  expected.  Closer  analysis  of  the  K>del  suggests 
one  plausible  explanation  for  this  behavior.  Plots  over  time  of  the 
state  variable  mean  statistics  produced  by  the  forecasting  system  are 
revealing.  These  distributions  have  peak  errors  at  the  identical  points 
in  time  where  the  scores  peak.  After  this  time,  the  forecasting  system 
generally  stabilizes,  although  with  higher  errors  than  In  the  early 
portion  of  the  sample  interval  Uess  than  A.O  in  straight  and  level  and 
0.8  in  turning  dive).  There  appears  to  be  a tradeoff  between  obtaining 
estimates  of  flight  control  states  at  peak  error  points  and  using  the 
"internal"  estimates  of  state  variable  values. 

Comarison  to  DAIS  Results 

The  results  appear  to  reflect  fairly  well  the  performance  of  the 
DAIS  subjects.  In  the  straight  and  level  flight  alone  maneuver,  DAIS 
subjects  averaged  a score  of  .7If  with  a standard  deviation  of  .2X9* 
Experimenters  indicated  that  the  highly  motivated  pilots  consistently 
performed  at  the  .5  level.  This  suggests  that  the  model  sai^ling 
interval  could  span  up  to  10  seconds  and  still  maintain  scores  within 
one  standard  deviation  of  the  DAIS  subjects.  Ukevise,  comparable 
scores  can  be  obtained  in  the  turning  dive  maneuver  with  sample  intervals 
up  to  1.6  seconds  where  the  DAIS  experimental  results  produced  a mean 
sccre  of  5-^95  with  a 1.135  standard  deviation. 

AnaiyaiB  of  Itofc  friorivy 

It  is  probably  quite  unrealistic  to  assume  that  the  MFK  tasks  do 
not  interfere  with  the  flight  control  variable  ssmpling;  nor  is  it 
apparent  that  the  pilot  operates  in  a strict  priority  mode.  He  more 
likely  "time  shares"  between  flight  control  and  switching,  appearing 
to  operate  almost  in  parallel.  This  behavior  is  difficult  to  represent 
in  a simulation  model.  One  possible  approach  (Case  2)  is  to  use  an 
interleave  scheme  during  the  switching  task  period  in  which  the  pilot 
alternates  between  an  MFK  subtask  and  a flight  control  display  update. 

With  no  sampling  permitted  during  the  individual  MFK  tasks. 

An  alternate  sampling  scheme  gives  switching  priority  over  flight 
control.  In  this  formulation  (Case  3),  the  pilot  would  under  no  condition 
interrupt  a keyboard  task  to  update  his  c^trol  task.  This  represents  an 
extreme  or  "worst"  case  in  terms  of  the  amotxnt  of  time  devoted  to  flight 
control. 

Models  of  Cases  2 and  3 were  exercised  for  both  maneuvers.  Table 
3 contains  a summary  of  the  score  statistics  for  all  three  cases.  In 
Case  2,  state  variable  sampling  is  performed  between  eac.  of  the  eight 
MFK  tasks,  each  of  which  have  mean  durations  of  1.08  seconds.  Curing  the 
"flight  alone"  segments  of  the  mission,  sampling  is  performed  at  the 
regular  specified  interval.  Thus  for  intervals  greater  than  1.08,  Case  2 
sampling  would  actually  occur  more  frequently  than  in  the  Case  1 condition, 
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TABLE  $ 

STRAIGHT  AID  LEVEL  AVERAGE  SCORES 


SAMPLE 

IHTERVAL 

(SEC) 

CASE  1 
(AVERAGE) 

CASE  2 
(AVERAGE) 

CASE  3 
(AVERAGE) 

1 

.1224 

.1330 

.2059 

2 

.1667 

.1599 

.2553 

3 

.20fl3 

.1972 

.2619 

4 

.2789 

.2551 

.4618 

5 

.7723 

.3293 

1.1880 

6 

.3995 

.3127 

.5549 

T 

.4138 

.3451 

.5148 

10 

.5431 

.3976 

.5028 

and  lover  scores  would  l>e  expected.  This  is  precisely  vhat  occurred. 

At  the  1 sec.  sample  Interral,  the  Oase  2 arera^  score  of  .1330  is 
higher  than  the  Case  1 score  of  .1224.  At  all  the  other  intervals 
(2  through  10} , the  Case  2 score  is  lover,  as  anticipated.  It  is  also 
of  interest  to  note  that  the  peak  at  5 sec.  is  harely  noticeable  due 
to  the  increased  sampling. 

In  Case  3 no  sas^ling  is  performed  during  the  NFK  svitching 
sequence,  which  has  an  average  duration  of  8.64  secs.  The  Case  3 
results  for  sample  intervals  between  1 and  7 secs,  indicate  scores 
which  in  all  instances  are  higher  than  the  Case  1 scores. 

Results  for  turning  dive  were  similar. 

SEHSITIVirr  AHALtSIS  OF  aWOREKTS  OF  ERROR 

Three  separate  flight  perfonsance  scores  were  recorded  for  each 
mission:  (l)  flight  alone  phase,  (2)  flight  and  MFK  svitching  phase, 

and  (3)  overall  mission  scores.  In  Case  3 the  intuitive  notion  was  that 
the  scores  would  be  much  worse  (higher)  during  the  combined  flight 
control  and  svitchir.g  se^ients  than  during  the  flight  alone  segments, 
since  no  sampling  was  permitted  during  these  sequences.  However,  this 
was  not  generally  true.  It  was  decided  to  examine  flight  performance 
in  more  detail  than  that  afforded  by  the  three  averaged  scores.  The 
simulation  was  rerun  with  a moving  window  scoring  procedure  based  on 
the  previous  seven  points. 

A graph  of  the  scores  for  the  turning  dive.  Case  3,  appear  in 
Figure  4.  The  d's  Indicate  when  MFK  switching  is  occurring.  No  clear 
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patterns  or  trends  exist.  There  appears  to  be  a great  deal  more  varia* 
bllity  in  the  scores  than  was  expected*  certainly  more  than  can  be 
ascertained  from  **!rean”  data.  The  extreme  range  of  the  scores  is  also 
of  concern.  At  some  instances  the  vehicle  is  very  well  controlled;  at 
other  points  in  time*  control  is  much  less  well  established. 

In  an  attempt  to  determine  if  these  characteristics  were  Just 
anomalies  of  tha  simulation  model*  a similar  graph  vas  prepared  for  a 
**typicel**  turning  dive  maneuver  from  the  real-time  experiment.  It 
shoved  the  same  degree  of  variability  as  the  model  outputs  and  also 
indicated  approximately  the  same  range  of  scores.  It  appears  that  the 
model  is  duplicating  fairly  well  the  performance  of  the  DAIS  subjects. 

An  attempt  was  .lade  to  determine  the  nature  of  this  variability. 

The  same  turning  dive  Case  3 condition  as  depicted  in  Figure  ^ was 
rerun  with  all  the  display  and  control  input  error  distributions  re- 
moved. The  surprising*  but  logical*  results  are  contained  in  Figure 
5.  It  appears  that  the  vehicle  is  in  good  control  upon  entering  the  MFK 
task.  £ven  though  no  sampling  occurs  during  the  MFK  task,  the 
aircraft  does  not  go  out  of  control.  However*  immediately  following 
the  switching  task*  the  pilot  reads  the  displays*  determines  he  has 
deviated  farom  the  command  values*  and  begins  to  correct  his  flight 
path,  fie  grossly  overcompensates * causing  the  peaks  in  the  score*  and 
takes  approximately  10  seconds  to  recover. 

The  decreasing  magnitude  ofthe  peaics  over  time  is  also  of  interest. 
This  siaggests  that  the  system  is  still  undergoing  a stabilization  period 
200  seconds  into  the  mission.  This  has  implications  on  man-in-the-loop 
experimental  procedures.  Allowing  the  subject  sufficient  time  to  achieve 
stabilization  before  initiating  scoring  could  produce  results  which  are 
overly  optimistic. 

Next,  the  display  errors  were  added  back  in»  The  results  of  this 
run  indicated  the  same  trend  as  the  "no-error"  case.  Addlting  the  u. 

(auigXe  of  attack)  and  u^  (roll  angle)  contro'^  errors  individually  ana 
in  conjunction  with  the  alsplay  errors  produ'.'d  no  significant  changes. 
Adding  u.  and  u^  together  produced  generally  the  same  results.  Including 
display  errors  with  u^  and  vl^  also  results  in  the  same  trend.  Adding 
u^  errors,  however,  prodaces^more  variability  and  is  never  really  in  a 
stable  mode.  It  more  closely  resembles  the  full  error  condition.  This 
suggests  that  the  largest  contributor  to  the  problem  is  the  difficulty 
in  controlling  throttle  (u^)*  with  some  additional  problems  with  the 
other  two  control  variables,  u.  and  u^.  Discussions  with  DAIS  experimenters 
and  more  detailed  examination  of  the  aata  proved  this  to  be  true.  It 
was  apparent  that  vertical  velocity  was  not  well  controlled  in  either 
maneuver,  but  particularly  not  in  turning  dive.  While  vertical  velocity 
is  a function  of  all  three  control  variables*  it  is  most  heavily  deter- 
mined by  throttle.  It  was  known  for  some  time  that  there  were  physical 
problems  with  the  response  characteristics  of  both  the  stick  and  the 
throttle.  The  stick  in  particular  had  an  extensive  amount  of  "dead 
space*'  around  the  center  point.  It  is  hypothesized*  based  on  the  above 
results  and  conversations  with  DAIS  experimenters,  that  the  DAIS  subjects 
had  an  exceptionally  difficult  time  controlling  the  stick  and  throttle* 
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resulting  in  extensive  variability  of  flight  ^rameters,  vertical  velocity 
in  particular.  This  could  very  well  te  the  reason  why  no  significant 
effects  were  reported  between  the  ^flight  alone”  and  "flight  plus  KFK” 
conditions.  The  high  variability  caused  by  poor  stick  and  throttle  hard- 
ware, coupled  with  inadequate  scoring  techniques  based  on  averages,  stay 
have  masked  the  true  effects. 

In  an  attempt  to  determine  what  might  have  happened  in  more 
realistic  experiments,  the  model  was  exercised  with  reduced  error  noise. 

The  results  indicated  much  more  sensitivity  and  showed  significant  differ- 
ences between  sampling  strategies. 

While  these  runs  certainly  did  not  "prove”  that  significant  dif- 
ferences woxild  have  been  found  in  the  real-time  man-in-the-loop  experi- 
ment had  the  stick  and  throttle  been  better  engineered,  it  does  demon- 
strate the  extreme  sensitivity  of  the  system  to  these  parameters,  and 
indicates  how  main  effects  may  very  well  have  been  hidden  by  their 
variability.  It  makes  a case  for  e:iiploying  a model  such  as  this  one  for 
determining  how  well-behaved  such  system  components  must  be  constructed 
to  perform  in  order  to  produce  desired  system  characteristics. 

This  analysis  also  poi  ts  to  the  need  for  examining  alternate 
scoring  form\ilations  other  than  the  "overall”  mission  score  employed. 
Ignoring  the  peaks  in  the  scores  immediately  following  the  MFK  switch- 
ing sequence,  and  using  only  "averaged"  scores,  necessarily  mask  the  true 
effects  due  to  the  secondary  tasks.  One  cannot  help  but  to  postulate 
that  the  outcome  of  the  man-in-the-loop  experiment  would  have  been 
different  had  the  controls  been  better  and  the  scoring  been  more  sensitive* 

SiHiTiftry  of  AdditiQaalJtoftlYsga 

In  addition  to  the  above  analysis,  several  additional  task  organi- 
zation and  strategy  questions  were  examined.  Two  of  these  are  briefly 
outlined  below. 

Eye  movement  data  were  used  to  incorporate  into  the  model  a 
probabilistic  finite  state  system  which  controlled  scanning  behavior. 

The  model  results  showed  little  sensitivity  to  information  gathering 
strategy  during  straight  and  level  flight  as  long  as  velocity  and  altitude 
variables  were  regularly  updated.  For  turning  dive  maneuvers,  flijht 
control  required  much  more  attention  and  g-load,  velocity  and  vertical 
velocity  were  the  key  variables. 

A second  sampling  strategy  termed  "probability  out  of  limit-" 
was  also  examined.  In  this  ease  the  variable  with  the  highest  pre  ability 
of  falling  outside  some  specified  window  was  sampled.  Probability 
estimates  were  based  on  the  mean  and  covariance  produced  by  the  linear 
model.  *nie  sampling  algorithm  also  required  that  every  state  variable 
be  sampled  periodically. 

In  straight  and  levd,  altitude  and  velocity  were  the  two  primary 
variables  sampled-  Vertical  velocity  and  g-load- were  seldom  sampled 
between  the  10  second,  "sample  everything",  intervals.  The  mean  scores 
for  all  three  cases  fall  approximately  between  the  3 and  k second  time 
intervals  of  the  reduced  error  case  results. 
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In  the  turning  dive  maneuver » vertical  valocity,  g-lo«d,  and  velocity 
vere  all  sempled,  with  vertical  velocity  being  sampled  most  frequently. 

The  other  three  state  variables  vere  sampled  together  every  5 seconds. 

In  comparing  these  results  to  the  reduced  error*  equal-interval  sampling 
scores,  it  was  found  that  these  results  fell  Just  slightly  above  the  0.8 
second  interval  scores.  This  suggests  that  similar  scores  can  be  obtained 
by  sampling  everything  0.8  seconds  or  by  sampling  one  of  three  variabl'^s 
every  0.2  seconds. 

Closer  examination  of  the  individual  runs  produced  additional 
insights.  In  the  equal- interval  sampling  rtms,  the  standard  deviation 
of  the  score  is  approximately  equal  to  the  mean  overall  score.  Thus 
there  is  a great  deal  of  variability  in  flight  control  performance,  as 
evidenced  by  the  peaks  immediately  following  the  NFK  task  sequence.  This 
is  not  true  in  the  **probability  out  of  limits'*  sampling  case.  There 
are  no  sharp  peaks  and  the  variances  of  the  scores  are  much  lover. 

Ihese  trends  may  be  important  in  analyzing  workload  issues.  In  peak 
workload  or  stress  situations,  it  may  be  critical  that  the  score  (as 
an  estimate  of  the  level  of  flight  control)  not  go  above  a certain  level  * 
at  any  given  time,  even  though  the  average  performance  score  is  veil 
vithin  limits.  If  this  type  of  behavior  is  required,  one  may  opt  for  the 
"probability  out  of  limits"  type  sampling  approach.  !ZMs  type  of  sampling 
also  appears  to  be  oiore  represeutative  of  actual  pilot  flight  performance 
in  that  the  variable  which  deviates  the  most  from  the  allowable  range 
is  the  one  attended  to.  Tbxs,  in  a sense,  a built-in  priority  scheme 
is  exercised. 

SUMMARY  AND  UQHCLUSIQHS 

The  feasibility  of  employing  a combined  modeling  approach  was 
demonstrated  through  successful  application  to  the  DAIS  system.  This 
modelling  approach  reduces  the  weaknesses  of  employing  either  network 
or  continuous  control  techriques  independently  in  modelling  monitoring 
and  supervisory  control  systems.  The  discrete  task  activities  and 
decision-making  processes  of  the  human  operator  vere  explicitly  repre- 
sented along  with  his  continuous  trackinu  behaviors.  * 

The  approach's  utility  as  an  analysis  tool  in  the  design  of  man- 
in- the-loop  experiments  was  demonstrated.  It  can  be  used  to  evaluate 
and  establish  operator  procedures  and  the  experimental  protocol  cr 
scenario  prior  to  actually  running  the  experiment.  For  example,  results 
of  the  DAIS  analysis  indicated  that  the  aircraft  required  a relatively 
long  stabilization  period  and,  hence,  provided  direction  for  the 
appropriate  collection  of  data  and  the  sequencisij  of  maneuvers.  This 
effort  also  demonstrated  how  the  technique  can  be  eaqployed  in  determining 
optimal  hardware  configurations  and  accuracy  requirements.  The  DAIS 
simulator  stick  and  throttle  devices  were  known  to  have  defects.  The 
slaulatiou  outputs  indicated  the  severity  of  these  defects  and  could  be 
used  to  assess  accuracy  requirements  in  order  to  achieve  predetermined 
levels  of  system  performance. 
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ABSniCT 


Bunan  dacisioo  nakiiif  in  nultii^a  process  nooitoriof  situations  is 
considarad*  It  is  proposad  that  taunan  dacisioo  nakinc  in  nany  nultipla 
proeaas  nonitoriof  situations  can  ba  aodalad  in  tarns  of  the  Hunan's  dataction 
of  process  ralatad  events  and  bis  allocation  of  attention  anonc  processes  once 
he  feels  events  have  occurred  * 4 nathanatical  nodal  of  hunan  event  dataction 
and  attention  alloeatioo  parfomanca  in  nultipla  process  nonitorinf  situations 
is  davalopad.  4n  assunption  node  in  davalopind  the  nodal  is  that,  in 
attanptinE  to  detect  events,  the  h«M  fenerates  estinates  of  the 
prohabilities  that  events  have  occurred.  An  elenentary  pattern  recognition 
technique,  diserininant  analysis,  is  used  ta  nodal  the  hisMa's  generation  of 
these  probability  estinates.  The  perfomance  of  the  nodal  is  conpared  to  that 
of  four  subjects  in  a nultipla  process  nonitoring  situation  reqtdring 
allocation  of  attention  naong  processes. 


(DThis  research  uas  supported  by  the  Rational  Aeronautics  and  Space 
Adninistration  under  R4M-4nes  Grant  RSC-2119* 
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xmooucnoi 


TH^r*  mrm  mmuf  sltustlOM  la  ahleli  Um  hwiaa  oparator  auat  aoaltor  various 
proeassas  aad  daclda  ulMthar  aad  idiaa  to  dlraet  his  attaotioa  to  oaa  of  thsu. 
Exsaplas  of  such  mlti^tasii  sltuatioas  iaeluda  tha  Maitoriag  of  iodustrial 
plaats,  pouar  systaas.  aad  air  traffio*  Product  laspactloa  aad  aircraft 
pilotlat  tasks  provida  addltloaal  asaiplas.  As  tha  ooaplaxity  aad  parfonaaaoa 
daMBds  of  such  sltuatioas  laeraasa,  the  oparator  aust  supanrlsa  aora 
proeassas  of  graatar  varlaty.  thara  is  ooassdusatly  aa  lacraasad  probahility 
that  ha  uill  aaeouatsr  sltuatioas  la  idileh  thara  arlsa  aora  tasks  thaa  ha  oaa 
aceaptahly  parfom. 

Qha  Bsans  of  aaiataialag  tha  oparator*s  uorkioad  at  a satisfactory  laaal  is 
tha  latroductioa  of  autoastioa  espahla  of  parforaiag  aoaa  of  tha  oparator*s 
tasks.  Medals  of  tha  oparator*s  task  parforaaaca  muld  ha  of  usa  ia 
pradietiof  tha  parforaaaea  galas  to  ha  aapaetad  froa  tha  latroductioa  of  such 
aids.  Further,  ia  systaas  ia  uhieh  tha  raspoasibilitias  for  soaa  tasks  ara 
sharad  by  tha  oparator  sad  aa  autoaatad  dacisloa  aahar«  thasa  aodals  eight 
also  ba  used  uithin  tha  systaa  to  ooordiaata  tha  aetioas  of  tha  tuo  dacisloa 
ashers* 


Saadars  (1)  aad  ^alluood  <2)  hava  aodalad  hrasa  daoisioa  aaklag  la 
aultipla  prooass  aoaltoriag  tasks.  Saadars  aaployad  aa  iaforaatioa  theory 
approach  to  dataraina  hou  oftaa  aad  for  uhat  duratioa  tha  taasa  aust  saapla 
aach  display.  ftMlluood  proposed  that  tha  tfmma  oparator  foras  aa  lataraal 
aodal  of  tha  proeassas  ha  is  aoaitoriag  aad  of  tha  aaviroaaaat  ralavaat  to  his 
task  as  a result  of  his  past  parcaptioas  of  thaa.  Carboaall  (3t^)  aad  Saadars 
aad  Posaar  (5)  hava  proposed  quauaiog  theory  approaches  to  tha  aodaliag  of 
huaan  dacisloa  aakliig  la  aultipla  prooass  aoaitoriag  tasks.  Klainaaa  sod 
Curry  (6)  have  applied  ooatrol  thaoratlo  taehaiguas  to  develop  aodals  of  huaan 
parforaaaoa  in  such  tasks. 

tha  aodals  cited  above  aaphaslsa  tha  aoaitoriag  of  displays,  rathar  than 
tha  daclsloas  or  aotloas  that  result  froa  tha  huaan  operator’s  paroaptloo  oT 
the  displayed  values.  Tha  operator’s  aotlvatloo  for  aonltoring  tha  displiqfs 
Is  tha  possibility  that  an  avaat  uhioh  raqulras  his  aotion  ulll  oocur.  tha 
aultl^task  dacisloa  asking  problaa  addressed  in  this  paper  oonoams  tha  event 
datactloa  and  aotioo  aalaotlon  decisions  tha  oparator  aakas  on  tha  basis  of 
tha  inforaatloa  ha  gains  through  aoaitorlng. 

huaan  decision  asking  In  such  aultl-task  situations,  than,  night  ba  aodalad 
In  tarns  of  tha  manner  in  uhieh  tha  human  detects  events  ralstad  to  tha 
proeassas  and  tha  manner  in  uhioh  ha  allocates  his  attention  among  tha 
processes  once  ha  feels  events  have  occurred.  Gal  and  Curry  (7)  have 
davalopad  a aodal  of  tha  huaan  monitor  In  a failure  detection  task.  The  aodal 
has  tuo  stages,  tha  first  s Kalman  filter  uhleh  astlaatas  tha  states  and 
observations  of  tha  aonitorad  process,  and  tha  second  a decision  aachsnlaa 
uhleh  operates  on  tha  Kalman  filter  residuals  using  saquantlsi  analysis 
concepts.  Sheridan  and  l\ilga  (8)  have  aodalad  tha  manner  In  uhioh  tha  huaan 
oparator  allocates  his  attention  along  various  tasks.  They  address  a 


9lt«Mtlea  la  Mtiieb  avaata  praaant  tbanaalvaa  laiaqulaoeally  aad  uaa  a 4yaaaie 
prrur—lat  approach  to  dataralaa  tba  aettoa  aaquaaea  Mhieh  MXlalaaa  tha 
oparator'a  aamlaca. 

■ouaa  (9)  haa  lavastitatad  tha  laaua  of  alloeatioe  of  daolatoa  aakiac 
raapoaalbllity  hatwaaa  a Iwua  oparator  aad  aa  autooatad  daoialoa  aaiaar.  Ha 
preaaeta  a aatbaatleal  foraulatloa  of  aultt-taak  daeialoa  aakioc  altuatioaa 
approprlata  to  aodallaf  a'  har  daeialoa  aakar.  Baaad  oa  dlaplayad 
laforaatloa,  tha  daeialoa  aakar  la  aaataad  to  gaaarata  prohahllltlaa  that 
avaeta  ha«a  oeeurrad  la  hla  taaka.  Ha  alao  gaaarataa  daaalty  fuaetloaa  Mhieh 
eharaetarlaa  hla  pareaptloaa  of  idMt  alght  oeeur  la  hla  taaka  Mhlla  hla 
attantloe  la  dlvartad  to  a partleular  taak  aad  how  loot  hla  attaettoa  will  ha 
dlvartad  ahould  ha  daelda  to  taka  a glvaa  aetloa.  Glvaa  tha  aatlaataa  of 
avaat  oeeurraaea  prohahllltlaa  aad  tha  pareaptloaa  of  daaalty  fuaetloaa  of 
latararrlval  aad  aetloa  tlaaa,  tha  daeialoa  aakar  la  aaauaad  to  ehooaa  aetloaa 
ao  aa  to  alaialaa  aa  approprlata  coat  erltarloo. 

Thla  foraulatloa  haa  baaa  appllad  to  tha  daalga  of  a eoaputar  aldad 
daeialoa  aaklag  ayataa  wlthla  a quaualag  theory  fTMOwork  (10,11).  Iteo 
oxparlaaata  within  a flight  aanagaaant  ooataxt  ware  uaad  to  llluatrata  tha 
value  of  thla  aultl»taak  foraulatloa.  It  waa  found  that  tha  quaualag  theory 
aodal  provided  a quite  raaaoaabla  daaorlptloa  of  aultl-taak  daeialoa  aaklag  la 
tanM  of  taak  waiting  tlaaa  aad  utUlaatloa  (l.a..  fraetloo  of  tlaa  buay)  of 
daeialoa  aakara.  Tha  nature  of  tha  flight  aaaagaaant  taak  aoplc.  ad  la  thla 
raaaarch,  however,  allowed  avoldaaea  of  tha  laaua  of  how  tha  hiaun  daeialoa 
aakar  dataeta  avanta. 


k NOOCL  OF  HIMAM  DECISION  NAKIHC 


In  thla  aaetlon  wa  propoaa  a nodal  of  huaan  daolalon  aaklng  In  a aultlpla 
proeaaa  nonltorlng  altuatlon.  The  aodal  aaataiea  that  tha  hiaaan  uaaa  a 
weighted  linear  eoablnatlon  of  varloua  faatur.a  to  generate  aatlaataa  of  tha 
probabllltlaa  of  event  ooourraneaa.  k dlaerlainant  analyala  approaeh  (12,13) 
la  aaployad  to  nodal  tha  hiaian'a  generation  of  thaaa  probability  aatlaataa. 
Thla  pattern  raeognltlon  taohnlqua  la  ananahla  to  real •tlaa,  adaptive 
laplaaantatlon.  k eoaputar  aiding  aehana  baaed  on  auoh  a nodal  would  have  the 
capability  of  learning  to  generate  approprlata  event  occurranoe  probability 
aatlaataa  through  obaarvatlcn  of  tha  huaan  oparator'a  taak  perfornanea.  Tha 
aodal  night  than  aaaiain  daolalon  aaklng  raaponalbllltiea  idien  tha  huaan 
bacoaaa  overloaded. 

For  each  p>-oeaaa.  It  la  aaaiaiad  that  tha  hiaan  aitracta  varloua  faaturea  X,, 
jal,2. ...p,  froa  hla  obaarvatlona.  Thaaa  faaturea  are  propertlea  of  the 
obaarvatlona  that  eharaetarlaa  (or  are  balltvad  to  charaotarixe)  tha  praaanee 
or  abaanea  of  avanta  related  to  tha  proeaaa.  Following  tha  extraction  of  a 
aat  of  faaturea,  tha  value  of  a linear  dlaerlainant  funetlon 


Y ■ v.X,  + . . . + V X 
11  p p 


(1) 
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te  oalouiatad.  BM«d  on  prcvloiM  «ip«rt«M«  iiLtli  tlM  proocM.  MtlMtM  arm 
■ad*  of  tiM  dlasrlBlaant  fXaetlM  oooffleloato  v.,  mIUi  «*««»»  to 
ooBblna  tbt  foaturo  vaiuas  X,  to  obtaia  tba  dtaoflalaaBt  fWMUoa  aaora  T that 
boat  dtfforaattatoa  obaonratloaa  of  avaata  Mraa  tba  raat  of  tba  proeaaa 
ralatod  obaarvatloaa.  Eatlaataa  of  tba  Maa  aad  vartaaoa  of  tba  dlaorlalaaat 
fuaetloa  ovar  obaarratloaa  of  avaata  aad  oaar  tba  raat  of  tba  obaanratlaaa  arm 
alao  foraad.  Iba  a poatarlorl  probability  that  aa  avaat  baa  ooourrad  la 
faaaratad  uataf  tba  valua  of  tba  dlaerlalaaat  fuaetloa  aaora,  tba  aatlaataa  of 
tba  aaaaa  aad  varlaaeaa  of  tbla  aaora  evar  avaata  aad  "aoa  avaataP.  aad  aa 
aattaata  of  tba  a priori  probability  of  tba  avaat.  lha  raadar  la  rafarrad  to 
(12)  for  a davalopaaat  of  tba  aatbaaatloa  tbramb  ublab  aa  dataralaa  tba 
dlaarlalaaat  fUaotloa  ooafflolaata.  tba  aan  aad  varlaaaaa  of  tba  raoultlag 
dlaorlalaaat  (laiotloo,  aad  flaally,  tba  a (•'^atarlorl  probability  that  aa  avaat 
baa  ooourrad  ooodltloaad  upea  tba  valua  of  tbla  fuaatlaa. 

If  a prooaaa  of  uBkDOMO  state  (avaat  praaaat  or  aot  praaaat)  la  obaarvad, 
faaturaa  X,.  Jb1.2....,p,  are  aatraetad  ftraa  tba  obaarratloaa,  aad  tba  valua 
of  tba  dladrlalaaBt  fiaiotloa  T la  oalealaitad  aa  praaorlbad  by  id.  (1),  tba  a 
poatarlorl  probability  that  aa  avaat  baa  ooourrad  la  glvaa  by 


Ka/T)  • acp<-  x^^/^)/  I «P(-  X^^^/2) 
fc-1 


(2) 


- - ? ^^l^/\(y)  ♦ la  D^(y)  - 2 la  p^  ‘'-1,2  (3) 


aad  II  (y)  are  tba  t<*aap  aaaaa  aad  varlaaaoa,  raapaotlvaly,  of  tba 
dlaorlalaaat  ftaiotloa  baaed  oa  pravloua  obaarvatloaa  takaa  at  tlaaa  at  ublob 
00  ava.it  related  to  tba  prooaaa  uia  praaaat  (lul)  aad  at  tlaaa  at  ublob  a 
proeaaa  related  avaat  uaa  praaaat  (kv2) . p^  la  tba  a priori  probdbUlty  of  oo 
avaat  (kal)  or  c«  avaat  (ka2). 

If  tba  ^uMa  operator  la  foroad  to  oaka  a yaa/oo  raapooaa  oa  tba  praaaaoa 
of  ar  •vaat,  aa  olgbt  aaaiiM  that  ho  ohooaaa  tba  raapooaa  ublob  aaxlalaaa  bis 
as:  itad  rauard.  Wa  oao  tbao  axpraaa  bis  daolsloo  la  a slgoal  dataotloo 
oairftar  sod  state  that  bo  should  ra^od  *yas,  aa  avaot  ralstad  to  proeass  1 
MS  ooourrad"  If  tba  followlag  laaquallty  holds: 


P(a/TVri  - P(a/T)J  > * Sl^ 


(♦) 
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P(«/T)  is  tiM  « posteriori  probability  that  a prooaas  ralatad  avaot  has 
ooeurrad  and  is  ionaratad  as  daseribad  sbova.  f„  is  tha  valua  of  oorraeUy 
raapoodioi  •no  avant*  (a  corraet  rajaction).  U tha  cost  of  inoorraeUy 
raspoik.ia(  •avar.t*  (a  falsa  alara),  V»  is  tha  valua  of  eorracUy  raspondii^ 
•avant*  (a  hit),  and  CL  is  tha  cost  or  incorrectly  responding  *no  event*  (a 
aiss) . ” 

It  is  predicted.  than,  that  if  tha  operator  is  forced  to  aalca  a yas/no 
decision  on  tha  prasanca  of  a process  related  event.  ha  calculates  tha 
likelihood  ratio  of  tha  event  (tha  left  hand  aide  of  Sq.  (t)).  Ha  ecaparas 
tha  aagnituda  of  tha  likelihood  ratio  uith  a threshold  datarainad  by  tha 
values  of  correct  responses  and  tha  costs  of  inoorract  responses  (tha  right 
hand  side  of  Eq.  (t)).  Ha  responds  •avant*  if  tha  likelihood  ratio  asoaads 
tha  threshold. 

In  aany  situations,  houavar.  tha  decision  nakar  is  not  forced  to  make 
yes/no  decisions  uith  respect  to  each  of  tha  procassas.  Ha  is  instead  faced 
uith  a situation  in  which  tha  decision  to  taka  action  with  respect  to  a 
process  Inplies  tha  allocation  of  attention  to  that  process  for  som  «ount  of 
tiaa  and  tha  diversion  of  attention  ttpm  other  processes  during  that  tine.  If 
wa  consider  this  dacSsion  asking  problaa  in  tha  contest  of  the  aathaaatical 
fofwulation  presented  in  House  (9)  and  House  and  (Sreenstein  (It),  another 
aodaling  approach  suggests  itself.  It  was  assimed  in  that  foraulation  that 
the  huaan  operator  has  perceptions  of  the  probabilities  that  events  have 
occurred  in  tha  procasses.  p(./^.  tha  Joint  probability  density  function  of 
the  tiaa  between  events  in  the  processes.  f(./i).  and  tha  Joint  probability 
density  function  of  tha  action  tiaes  for  the  processes.  g(./£).  The  operator 
is  to  decide  which  actions  of  the  set  SQ,S|.....ap  should  be  parforaed*  Ha 
aight  choose  Sq  (the  decision  to  continue  aonitoring)  in  order  to  obtain  new 
Inforaation  with  which  he  can  update  p(./2.)*  If  ha  chooses  a.,  1^0.  he 
services  process  i for  soae  aaount  of  tiaa  and  is  unable  to  aoniur  or  attend 
to  the  other  H*1  processes  until  servicing  of  process  i is  coapleted. 

IHe  operator  aight  be  aodelad  as  deciding  whether  to  continue  aonitoring 
all  processes  or  to  divert  his  attention  to  soae  of  the  processes  by  utilising 
his  perceptions  of  p( */Z) . f( ./Z) e and  g( ./Z)  to  dateraine  a sequence  of 
actions  which  ainiaisa  an  appropriate  cost  criterion.  If  wa  want  to  (tnalise 
deviations  of  process  state  g.  tram  soae  desired  state.  then  we  aight 
foraulate  tha  criterion  so  as  to  allow  use  of  control  theoretic  techniques. 
On  the  other  hand,  if  wa  are  interested  in  ainiaizing  tha  average  tiaa  froa 
occurrence  of  a process  failure  to  coapletion  of  service  to  that  process, 
queueing  theory  provides  an  appropriate  aathodology.  Because  the  general 
Bultipla  process  aonitoring  situation  does  not  inherently  involve  processes 
whose  states  can  be  described  by  linear  dynaiic  systeas.  we  will  consider  a 
criterion  involving  ainiaizstion  of  the  costs  of  delays  in  service  to  failed 
processes.  In  particular,  let  us  consider  the  following  cost  criterion  as  one 
which  the  operator  aight  seek  to  ainiaize: 


E(C/T)  - (l/T)E[c^Wj^  CjWj  + ^ 
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wtMTtt  « Is  um  d«I«y  •xp«rl«iie#d  bf  proofs*  1 and  Ineludas  Um  vnitlnc  tlan 
until  laltlntloii  of  nonrleo  and  tba  aanrioiag  tiaa*  o.  la  tba  ooat  par  unit 
tiaa  of  dalay  in  aanrloa  to  prooaaa  1*  and  T la  tba  aiowt  of  tisa  fbr  abioh 
tba  oparator*a  attantloo  la  dlvartad  froa  hla  dlaplaya  aa  a raault  of  hla 
action  aaquanea* 

Throuabout  tba  raaalndar  of  this  papar  aa  alll  aaaiM  Indapandaooa  aaong 
procaasaa.  That  la.  It  ulll  ba  aaauaad  that  tba  probabllltlaa  of  aaanta 
having  occur rad  In  tba  proeaaaaa  ara  Indapandant  laong  prooaaaaa*  Thus 


p(*/l>  • a(aj^/*l^)p(a2/*2^  •••  P(f|/l|l>  W) 


SLallarly,  tba  tlsa  bataaan  avanta  and  tba  tlaa  raqulrad  to  attaod  to  a 
prooaaa  ara  Indapandant  Mong  prooaaaaa.  Thus 


f(-/2)  - ••  VW 


and 


*<*/!)  " •••  W 


Gonaldaratlon  of  Intardapandanolaa  anong  prooaaaaa  Mould  ocnplloata  tba 
analysis  substantially.  It  should  ba  notad  bowavar,  that  tba  aaaunptlon  of 
Indapandanoa  Mong  prooaaaaa  Is,  In  nany  raallstlo  situations,  difficult  to 
Justify. 

Lat  us  approach  tba  problan  by  avaluatlng  aaob  o.w.  oonponant  of  E4,  (5) 
for  a oandldata  action  saquanoa,  Prooaadlng  fron  CqS,^  (6),  (7),  and  (8),  lat 
us  (lOM,  for  tba  saka  of  slnpllolty,  aaauna  that  only  ona  typa  of  avant  In  aaob 
prooaaa  la  of  Intarast.  Lat  us  also  sssuna  that  tba  tina  batuaan  avants  In  a 
prooaaa  and  tba  tlaa  raqulrad  to  attand  to  a proeass  Is  Indapandant  of  tba 
obsanratlons,  I,  than 


f(-/2)  - •••  W 


and 
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If  tl»  htaiM  ohoos*9  to  porform  action  «.  thon  Um  oost  duo  to 

iCBorlag  proonas  1 for  tlao  t^,  glvan  that  an  avant  a^  haa  ooourrad  la 


and  tha  coat  dua  to  Ignoring  prooaaa  1 If  an  avant  a^  oceura  aftar  Initiation 
of  action  a^  la 


t > 

a 


c 

€ 

t 


Therefore,  if  the  huean 

ttCiWi/ajI  ■ P(«i/*j)c4 


chooaas  to  parfona  prooaaa  a^, 

/ Vi".’-*'. 

0 


(1#J),  than 


+ U - p(aj^/a^)lcj 


m 

/ 


/ 


(t^-  t^>f(t^)g(t^)dt^dt^ 


0 


(11) 


Hhara  tha  flrat  tana  la  tha  aipaotad  coat  of  Ignoring  prooaaa  1 for  tlna  t 
dua  to  an  avant  a,  that  haa  oecurradt  uhlla  tha  aaoond  tarn  la  tha  aapaotad 
oost  dua  to  an  avant  a^  occurring  during  t^. 

If  avant  Intararrlval  tlaaa  In  prooaaa  1 ara  axponantlally  dlatrlbutad  with 
naan  and  action  tlnas  ara  oonatanta  tj.  J>0,1 N,  than 

S[CiWi/ajl  - p(aj^/tj^)c^tj 


+ (1  - 


a 


(12) 
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5UAUTV 


ted.  upon  cnrrytnc  out  th«  tndieatod  int«(rstion. 

♦ U - - (1/X^)(1  - «Kp(-  (13) 

testae  that  the  huaaa  plana  ahead  tuo  aetlcns,  a^  and  a|^,  (ipj.k).  Then 

+ H - P(ej/sj)lc^  I (tj  ♦ t|^  - t^)X^e*p(-  X^t^)dt^ 

0 

- p(e^/*^)Cj(tj  ♦ t^) 

+ [1  - p(ej^/*j^)ICj^[tj  + t|^  - (l/Xj^Xl  - exp(-  + tj^)))l 


Generalizint  to  action  aaquaneas  of  lantth  >•  va  bavo 

Etc^Wl/*jP  -.•  » • P(«^/»^)c^(tj  ♦ ...  + tj^) 

11  - p(e^/^)]c^ 

• {tj  - (1/A^)(1  - axp(-  4*  ...  + t^)))] 

1 # J.  ...  .1  (14) 


Suppose  action  a.  is  parfornade  If  tha  waiting  tiaa  w.  is  aaasured  from 
tha  tiaa  of  failure  to  tha  tine  of  service  ooaplation  and  it  is  assuaad  that 
servicing  of  process  i precludes  the  possibility  of  failures  during  servicing, 
then 


(IS) 
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Suppose  after  aetloo  a.  other  aotions  e^ m are  perforsed.  The  cost  to 

process  1 incurred  by  tMse  actions  Is  "due  only  to  the  cost  of  Ignorlnc 
process  1 if  an  event  e.  occurs  after  oospletlon  of  service  to  process  i 
(since  process  i is  in  the  nomal  state  upon  coapletion  of  service  to  it). 
Therefore 

E(c^Wi/a^,  •••  » aj  - 

c^[(t^  + •••  + t^)  - (lA^Kl  - exp(-  X^(t^  + + t^)))]  (16) 


So  • the  expected  cost  in  process  i incurred  by  an  action  sequence 

*jf«*a^.ai,a^,*..,aQ  can  be  expressed  as 


B[Cj^w^/a^ » • • • • a^,  * « * • a^} 

+ tj^) 

+ [1  - p(e^/x^)]c^ 

+ ...  (1A^)(1  - exp(-  X^(tj  + ...  + tj^)))l 


+ c^[(t^  + ...  + t^) 


- (lA^)d  - «xp(-  X^(t^  + ...  + tjj)))] 


(17) 


The  total  cost  incurred  by  an  action  sequence  a.,,..,a^.a^,a_»...»aQ  over 
the  tine  duration  of  the  action  sequence  is  then  (iven  by  tne^suHMtxon  of 
costs  over  the  total  nunber  of  tasks • N.  Thus, 

N 

E[C]  ■ J Ifc^w^/Sj,  ...  , a^,  a^,  a^,  ...  a^]  (18) 

1-1 
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and  tha  rapaotad  coat  par  unit  tlaa  Inourrad  by  tha  action  aaquanca  (uhich  ia 
tha  coat  eritarion,  Eq.  (5)«  undar  oonaidaration)  ia  «tiarafora 

EtC/T]  - 


N 

(I  E[CjWj/a., 

1-1  ^ J 


•^p  •••  + •..  + t^) 


(19) 


We  have  thus  far  expresaed  the  expected  cost  per  unit  tUie  for  an  action 
sequence  In  tenas  of  p(  ./D . f ( »/D , and  g(  ,/^)  • and  carried  through  the 
developaent  of  this  expression  for  the  case  of  exponentially  distributed  event 
interarrival  tiaes  and  constant  service  tiaes.  Let  us  notf  suggest  a specific 
Bodel  of  hiaan  decision  asking  uhioh  considers  the  expected  coat  per  unit  tiae 
of  certain  action  sequences  and  selects  fTca  Mong  these  candidate  sequences 
the  action  sequence  which  ainiaizes  this  coat  criterion. 

We  suggest  that  the  operator  aight  be  aodeled  as  initially  estiaating  the 
expected  cost  per.  unit  tiae  incurred  by  the  decision  to  continue  aonitoring 
for  a period  of  tiae.  If  acting  with  respect  to  any  one  process  before 
aonitoring  would  not  result  in  a lower  expected  cost  per  unit  tiae  (over  the 
tiae  interval  required  to  act  on  the  process  and  then  aonitor),  the  operator 
siaply  elects  to  continue  aonitoring. 

If  acting  with  respect  to  a process  before  aonitoring  results  in  a lower 
expected  cost  per  unit  tiae  than  aonitoring  alone,  .the  operator  deteraines  the 
action  which  results  in  the  ainlaiai  expected  cost  per  unit  tiae  and  assigns  to 
it  the  first  position  in  his  actioii  sequence.  He  then  determines  whether 
acting  with  respect  to  any  of  the  reaainlng  processes  before  aonitoring  would 
lower  the  expected  cost  per  unit  tiae  of  his  action  sequence  further.  If  it 
will  not,  he  responds  to  the  one  process  he  has  placed  in  his  action  sequence 
and  then  continues  aonitoring. 

If  acting  with  respect  to  one  of  the  reaaining  processes  before  aonitoring 
does  lower  the  expected  cost  per  unit  tiae  of  his  action  sequence,  the 
operator  deteraines  the  action  which  results  in  the  ainiaua  expected  cost  per 
unit  tine  and  assigns  to  it  the  second  position  in  his  action  sequence.  The 
procedure  continues  until  the  addition  to  the  sequence  of  an  action  with 
respect  to  any  of  the  raaaining  processes  does  not  lower  the  expected  coat  per 
unit  tiae  of  the  sequence  or  until  actions  with  respect  to  all  the  processes 
have  been  included  in  the  sequence. 
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EXPERIMEMTAL  SITUATIOli 


An  eiperlB«ntal  situation  was  davsiopac!  to  faoilitata  tha  study  of  husan 
daoision  asking  in  a specific  Bultipla  prooass  aociitoring  task.  Tha  task 
inv ol vas  tha  siaultanaous  aoni toning  of  nina  dynaaic  prooassas  for  tha 
occurrance  of  abnoraal  avants,  a situation  raprasantativa*  for  sxaapla*  of 
aoni toning  tasks  in  coaplax  industrial  plants. 

Figura  1 illustrates  tha  display  obsarvad  by  subjaots  within  tha 
axpariaantal  situation.  Tha  display  is  static  and  is  ganaratad  on  a Taktronix 
4010  storage  tuba  display  by  a tiaa-sharad  DCC-Systaa  10  digital  ooaputar. 
Tha  display  depicts  tha  aaasi:rad  values  of  tha  outputs  of  nina  prooassas  over 
100  saapling  intervals  (i.a.,  101  aaasuraaants  are  depicted  on  tha  display  for 
each  process) . A tiaa  unit  on  tha  display  corresponds  to  tha  interval  between 
successive  saaplas  of  the  process  outputs. 


Figure  1:  The  aultlple  process  aonitoring  situation 


(Processes  4 and  6 have  failed  at  tines  86  and  110,  raspaotivaly.  Processes 
1,4,  and  6 have  bean  selected  for  service.) 
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The  proceasea  have  identloal  aeoond  order  ayatem  dyimlca  with  a natural 
frequr  icy  of  0.13  rad/tlme  unit  and  a daaping  ratio  of  O.3.  The  inputa  to  the 
proceriea  are  zero-aean  Gauaaian  white  noiae  aequencea  of  identical  variance. 
The  aiaplayed  aeaaurenenta  are  obtained  by  corrupting  the  proceaa  outputa  with 
additive  zero-aean  Gauaaian  white  noiae  aequencea  which  noraally  have 
identical  variance.  The  aeaaureaent  noiae  variance  ia  noraally  aeleoted  to 
yield  aeaaureaenta  with  aignal-to-noiae  ratioa  of  25.0. 

An  abnoraal  event  or  proceaa  failure  ia  defined  by  a gradual  increaae  in 
the  aeaaureaent  noiae  variance  following  proceaa  failure  auch  that  the 
signal-to-noiae  ratio  of  each  aeaaureaent  ia  dzcreaaed  to  95%  of  the 
aignal-to-noiae  ratio  of  the  iaaediately  preceding  aeaaureaent,  A proceaa 
failure  aanifeata  itaelf.  then*  by  an  exponential  decay  of  the  aignal-to-roiae 
ratio  for  aeaauraaenta  following  the  tiae  of  failure.  Thua*  fail’  becoae 
more  pronounced  with  each  aeaaureaent  following  their  occurrence.  ia  ia 
illuatrated  in  Figure  2:  all  nine  proceaaea  have  failed  at  var  V/lnta 
within  the  tiae  range  depicted  on  the  diaplay.  The  pointa  at  w hea%; 
fail urea  occurred  have  been  denoted  in  the  figure  by  aolid  verti  . ^^aea* 
Theae  linea  did  not  appear  on  the  diaplay  during  the  experiaent. 
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Figure  2:  A diaplay  in  which  all  proceasea  have  failed 
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Uhlit  the  exeot  nature  of  the  subjeot':  task  In  this  experlaental  situation 
differs  vdth  the  nrture  of  the  decision  asking  being  investigated  — * staple 
event  detection  or  action  selection  involving  alloratton  of  attention  aaong 
the  processes  — in  all  cases  the  subject  seeks  to  detect  events  in  processes 
and  service  these  processes  so  that  they  are  returned  to  the  noraal  state. 
The  amount  cf  time  required  to  service  a process  can  be  vrri*q  across  the 
processes.  If  the  amount  of  time  required  to  service  a process  is  nonzero, 
servicing  of  the  process  implies  a diversion  of  attention  froa  the  other 
processes  for  this  time.  The  cost  of  delaying  service  to  a process  can  also 
be  vcried  froa  process  to  process. 

The  above  aspects  of  the  situation  are  quantified  by  assooiating  a set  of 
two  parameters  with  each  of  the  nine  processes  the  mean  time  to  repair  the 
process  (MTTIt),  and  the  cost  per  unit  tine  of  delay  of  service  to  a failed 
process  (C).  If  the  tines  required  to  repair  a pfocess  are  assumed  oonstaiit 
or  exponential!,  distributed,  then  MTTR  ooapletely  specifies  the  distribution 
of  serv^-'e  times  for  that  process. 

After  scanning  the  nine  process  histories  depicted  on  the  display,  the 
subject  is  given  an  opportunity  to  key  in  the  numbers  of  processes  which  he 
has  decided  co  service.  He  also  uses  a graphic  cursor  to  entar  estiaates  of 
tines  at  which  he  believes  failures  have  ooourred.  Upon  conpletion  of  his 
entries,  the  processes  he  has  entered  are  serviced  in  the  order  in  which  he 
entered  them.  The  first  process  entered  by  the  subject  is  serviced  over  an 
Interval  which  begins  Kith  the  last  tine  point  displayed  on  the  screen  and 
extends  forward  the  number  of  tine  units  equal  to  the  MTTR  associated  with  the 
process.  At  the  completion  of  this  service  the  process  is  reset  to  normal  if 
It  has  failed  beforr.  this  point  and  service  is  begun  on  the  next  process 
entered  by  the  subject.  W'en  all  processes  entered  have  been  serviced,  the 
subject  is  given  feedback  regarding  the  ztate  of  each  serviced  process  at  the 
instant  before  servicing  of  that  process  was  completed  ("1"  indicating  the 
normal  state,  "0"  indicating  the  failed  state).  An  iteration  in  an 
experimental  trlcl  ends  with  erasure  of  the  display  and  the  scoring  of  the 
subject's  performance  on  the  iteration. 

Another  Iteration  is  then  begun  by  generating  a new  display  depicting  the 
process  histories  advanced  in  time  by  an  amount  equal  to  the  sum  of  the 
service  times  (NTTRs)  o.'  ''he  processes  entered  on  the  preceding  iteration  plus 
an  additional  constant  inoreaent.  The  additional  increment  is  included  to 
represent  thr  interval  of  time  required  to  monitor  the  processes  each  tiae 
they  are  diiplayed  (this  inoreaent  will  be  rsfarred  to  as  the  aean  time  to 
monitor  the  processes,  MTTM) . The  display  which  would  follow  that  shown  in 
Figure  1 is  illustrated  by  Figure  3.  The  NTTRs  associated  with  the  processes 
are  depicted  in  the  figure.  The  HTTH  employed  In  the  situation  Illustrated  is 
10  tiae  units.  It  should  be  noted  that  Figs.  1 and  3 presented  here  as 
illustratiors  of  the  experimental  situation  represent  iterations  u.'  displays 
which  would  fall  somewhere  in  the  middle  of  a subject's  experimental  trial. 
The  first  iteration  or  display  viewed  by  the  subject  in  an  experimental  trial 
would  depict  the  measured  values  of  the  nine  processes'  outputs  over  a tiae 
span  beginning  at  tiae  t>0  (as  labeled  on  the  horizontal  axes)  and  ending  at 
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Flfur«  3:  Th«  dlspl«]f  tdiloh  follons  that  ahow  la  Fit*  1 


(Tha  daahad  vartloal  linaa  Indloata  to  tha  subjaet  tha  point  at  idiloh  aanrloa 
of  aaoh  prooaaa  aaa  laat  oonplatad.) 


cxramcMT 


An  axparlaant  ana  oondootad  wploylof  tha  aultlpla  prooaaa  aoaltorlnt 
altuatlon  daaorihad  In  tha  praoadint  aaotloo.  Tha  taah  of  tha  aubjaot  in  thla 
avparlaantal  aituatlon  waa  to  aarvloa*  or  allooata  attantlon  to,  prooaaaaa  In 
a aannar  Mhloh  alnlalaad  tha  total  ooat  Inourrad  dua  to  dalaya  In  tha 
aarviolnc  of  fallad  prooaaaaa. 

Four  aubjaota  wara  glvan  alx  trlala  with  tha  aiparlaantal  aituatlon  ovar  a 
pariod  of  four  to  aix  daya.  Each  trial  oonalatad  of  25  Itaratkona  (an  Initial 
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dlaplv  folIoiMd  by  » upd«t<d  dlapUy)  and  wu  of  approxiutoly  aiautos 
duration.  Thraa  larala  of  NTtl  and  C atm  aaployad  aerosa  tba  niaa  proeoaaaa. 
Iha  valuas  of  NTTI  and  C aaaoelatad  witb  aaeh  of  tba  proeasaas  aara  as 
dapietad  in  Figs.  i and  3*  1b*  valua  of  MT1N  aaployad  In  tba  aiparinant  ana 
10  tina  units.  Ibaaa  valuas  uara  bald  constant  aerosa  all  trials.  Iba 
intararrival  tinas  of  tba  failures  aebadulad  to  occur  in  each  process  aara 
cxpoocntizlly  distributed  aith  a naan  tine  bataaan  failures  (NTBF)  of  ITS  tiaa 
units  in  all  proeasaas.  lot  all  aebadulad  failuras  actually  occurrad.  If  a 
failura  aas  aebadulad  to  occur  in  s process  in  uhieta  a previous  failure  bad 
not  bean  attended  to,  tba  aebadulad  failura  uas  delated  fren  tba  trial.  Iba 
intararrival  tines  used  to  sebadula  failures  on  tba  aiiecassiva  trials  given  a 
subject  differed  fr<a  trial  to  trial. 

Prior  to  baginniag  tba  six  trials  uitb  tba  axparinantal  situation  described 
above,  tba  subjects  uara  given  four  trials  in  uhieta  the  NTTIs  were  set  to  xoro 
and  the  Cs  to  one  for  all  proeesaea.  Witb  aero  NTII  and  equal  C for  all 
proeasaas , the  decision  to  allocate  attention  to  one  process  involved  no 
diversion  of  attention  fren  the  other  processes  and  a delay  in  sarvicing  one 
process  uas  no  nora  costly  than  a delay  in  servicing  any  other  proeaas.  After 
scanning  the  process  histories  depicted  on  tba  display,  the  subject  sinply 
entered  the  mabers  of  processes  in  uhieta  he  had  decided  failures  had 
occurred.  Ibaaa  trials  provided  the  subjects  with  experience  in  the  detection 
of  process  failures  uitbout  the  additional  task  of  deciding  bow  to  allocate 
attention  anoog  processes  with  different  attantiooal  requiranenta  and  costs. 
&ibjects  were  also  given  several  iterations  of  training  before  these  trials 
and  the  later  six  trials.  During  these  training  iterations,  solid  vertical 
lines  were  included  on  the  process  histories  to  nark  when  and  where  events  had 
occurred  (ace  Fig.  2).  Subjects  ware  not  given  any  infomation  regarding  the 
dynaics  of  the  processes,  but  were  told  that  they  could  expect  the  processes 
to  exhibit  sinilsr  characteristics  idicn  operating  nomally.  They  were  also 
not  told  what  paraieter  changes  defined  events,  but  ware  told  that  all  events 
would  generally  exhibit  sinilar  characteristics  and  all  would  becone  nore 
pronounced  as  tine  passed. 


APPLICATION  OF  THE  NODEL  TO  THE  EXPEKINEITAL  SITUATION 


The  decision  asking  nodal  suggests  t.;st  the  hunan  operator  in  the 
experiaental  situation  just  described  extracts  various  features  froa  his 
observations  of  the  process  aeasurenents . He  attanpts  to  select  features 
which  characterize  the  presence  or  absence  of  task  related  events.  Through 
his  experience  with  the  processes,  the  operator  has  forned  estiaates  of  the 
discriainant  function  coefficients  with  which  to  coabine  the  features  to 
obtain  a discriainant  function  score.  He  has  also  fomed  estiaates  of  the 
neans  and  variances  of  this  score  over  observstions  of  events  and  over  the 
rest  of  his  observations.  The  operator  generates  the  a posteriori  probability 
that  an  event  has  occurred  bas^  on  the  value  of  the  discriainant  function 
score,  his  estiaates  of  the  neans  and  variances  of  tha  score,  and  his  estiaate 
of  the  a priori  probability  of  an  event  occurrence. 
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Four  featuros  of  tha  procasa  MasuraBants  wara  aalaotad  for  uaa  with  tha 
event  detection  Bodal.  Selection  of  thaaa  faaturaa  waa  guided  by  tha  coManta 
of  expariaantal  aubjacta  in  a aisiXar  aituation  regarding  tha  oharactariatica 
of  the  procaaa  ■aaaur«ienta  they  found  uaaful  in  event  detection.  The  firat 
feature  involves  tha  aagnituda  changaa  batwaan  aueeaaaiva  ■eaauraBanta  in  a 
aequance  of  tha  Boat  recant  BaaauraBanta.  Tha  second  feature  involves  tha 
presence  of  reversals  in  direction  in  this  saquanea  (changes  froB  positive 
slope  to  negative,  or  vice  versa,  of  tha  line  aagBants  connecting  tha 
BeasuraBants  of  the  sequence).  Tha  third  feature  teats  for  tha  siBultanaous 
occurrence  of  large  aagnltude  changes  and  reversals.  Tha  fourth  feature,  like 
tha  first,  is  a Baasura  of  aagnituda  changes,  but  it  is  auch  aora  local  in 
that  It  Involves  only  the  four  aost  recant  BeasuraBants  of  tha  process  output. 

Given  that  events  beccaa  acre  pronounced  with  tlaa  following  their 
occurrence,  it  saaas  reasonable  that  tha  aost  recant  process  aeasuraaents 
would  be  of  greater  use  in  event  detection  than  older  aeasuraaents. 
Therefore,  in  extracting  features  froa  the  process  aeasuraaer.ts,  the  values  of 
the  features  over  recent  aeasuraaents  are  weighted  acre  heavily  than  the 
values  over  earlier  aeasuraaents.  The  weight  decreases  exponentially  with  the 
age  of  the  aeasuraaent  and  the  rate  of  this  decrease  la  a free  paraaeter.  Ihe 
value  of  the  first  feature,  for  exaaple,  a aeasure  of  the  aagnitude  changes 
between  successive  aeasuraaents  in  a sequence  of  the  n aost  recent 
aeasuraaents  of  a process's  output,  is  given  by 

n-1 

- (I|*(k+  1)  - f(k)!-«p[-  B(n  - 1 - k)]} 
k-1 


n-1 

/I  ,*p(-  B(n  - 1 - k)l  (20) 

k*l 


where  z(k)  is  the  k th  aeasuraaent  in  the  sequence,  z(n)  Is  the  aost  recent 
aeasuraaent,  and  $ is  the  free  paraaeter  governing  the  relative  tiaighting  of 
the  feature's  value  over  recent  and  earlier  aeasuraaents  in  the  sequence. 

The  estlaation  of  discriainant  function  coefficients  requires  a 
representation  of  noraal  and  abnormal  process  aeasuraaents.  This 
representation  was  foraed  using  the  process  histories  displayed  to  the  subject 
on  his  last  event  detection  trial  (l.e.,  the  fourth  of  the  four  trials  given 
In  which  the  MTTRs  were  all  zero  and  the  Cs  all  one).  The  process  histories 
are  separated  into  two  groups  of  sequences  — noraal  and  abnoraal.  Sequences 
of  aeasuraaents  beginning  at  the  point  at  which  a process  was  returned  to  the 
noraal  state  and  ending  at  the  print  at  which  an  event  occurred  (or, 
alternatively,  the  point  at  which  the  subject  est lasted  an  event  occurred)  are 
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defined  to  be  normal.  Sequences  of  measurements  beginning  at  the  point  at 
which  an  event  occurred  (or  the  point  at  which  the  subject  estimated  an  event 
occurred)  and  ending  at  the  point  at  which  the  process  was  returned  to  the 
normal  state  are  defined  to  be  abnormal.  In  obtaining  the  results  to  be 
presented  here,  the  points  at  which  the  subject  estimated  events  occurred, 
rather  than  the  actual  points  of  occurrence,  were  used  to  define  the  final 
points  of  normal  sequences  and  initial  points  of  abnormal  sequences.  This  was 
dene  to  test  the  ability  of  the  model  to  perform  adequately  in  situations  in 
which  true  event  times  are  unknown  and  a human  operator's  identification  of 
events  and  estimates  of  occurrence  times  represent  the  only  event  time  data 
available.  This  decision  is  consistent  with  our  Icng  term  goal  of  developing 
a computer  aided  process  monitoring  system. 

The  representation  of  normal  and  abnormal  process  measurements  formed  using 
the  process  histories  of  the  subject's  last  event  detection  trial  are  used  to 
determine  discriminant  function  coefficients  and  the  means  and  variances  of 
the  resulting  discriminant  function  scores.  If  the  model  is  then  to  be  used 
to  generate  the  a posteriori  probability  of  an  event  in  a process  at  a given 
iteration  of  an  experimental  trial,  the  nuaber  of  process  measurements  over 
which  the  features  are  to  be  calculated  must  be  defined.  It  is  reasonable  to 
assume  that  the  measurmaent  sequence  ends  with  the  last  measurement  displayed 
for  the  process  on  that  iteration,  liowever,  the  cutoff  length  which  indicates 
when  the  measurement  sequence  begins  is  a free  parameter.  Values  of  the 
features  over  process  measurements  taken  earlier  than  the  cutoff  are  not 
calculated  (or,  effectively,  are  assigned  zero  weight). 

(jeneration  of  the  a posteriori  probability  of  events  in  the  tasks  using  the 
discriminant  analysis  approach  requires  estimates  of  the  a priori 
probabilities  of  event  occurrences  in  the  tasks.  We  can  approximate  the  time 
between  consecutive  event  arrivals  to  a process  as  an  exponential  distribution 
with  parameter  1/MTBF.  (This  is  an  approximation  because  not  all  scheduled 
events  occurred.  Thus,  the  true  mean  time  between  failures  is  somewhat  larger 
than  the  nominal  value  used  to  schedule  the  arrivals.) 

If  we  let  U(t)  be  the  number  of  failures  in  a process  by  time  t (t>0), 
where  time  0 designates  the  instant  at  which  the  count  begins,  then 


p(U(t)  - n)  - t(t/mHF)“exp(-  t/MTBF)l/n:  n - 0,  1,  ; (21) 


Thus, 


p(U(t)  - 0)  - exp(-  t/MTBF)  (22) 


and  the  a priori  probability  that  an  event  occurs  in  the  proceis  at  or  before 
time  t is 


p(U(t)  ^ 0)  - 1 - exp(-  t/MTBF) 


(23) 
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Ue  Bodel  the  subject's  estimate  of  the  tiae  t that  has  elapsed  since  the 
process  ws  last  reset  to  noraal  (and  during  which  a failure  uy  have 
occurred)  as  the  ainiaua  of  the  time  since  service  to  the  process  was  last 
cQBpleted  and  the  tine  since  the  first  aeasureaent  presented  on  the  current 
display.  We  thus  assume  that  if  service  of  a process  was  last  completed  at  a 
time  point  earlier  than  th^  earliest  tiae  point  shown  on  the  current  display, 
the  subject  uses  the  earliest  tlae  it  on  the  display  as  his  estiaate  of  the 
first  point  at  which  a new  failure  may  have  occurred  in  process. 

Before  concluding  this  section  we  would  like  to  consider  a aodification  to 
the  basic  nodel.  Application  of  the  aodel  as  we  have  o ^^iaed  it  to  data 
obtained  in  the  eiperiaent  preseuted  Is  the  preceding  section  reveals  a 
disparity  between  the  performance  of  the  model  and  that  of  the  experimental 
subjects.  Specifically,  the  model  tends  to  respond  to  lower  NTTB  and  higher  C 
processes  more  often  than  the  subjects,  while  it  tends  to  respond  to  higher 
HTTR  and  lower  C processes  less  often  than  the  subjects.  In  an  attempt  to 
deal  with  this  disparity  while  retaining  the  potential  robustness  of  the 
model,  we  will  incorporate  two  additional  parameters  into  the  model. 

The  first  parameter  is  a lower  probability  threshold.  If  the  probability 
that  an  event  has  occurred  in  a process  J is  lower  than  this  threshold,  than 
process  J is  not  considered  for  inclusion  in  the  action  sequence,  even  if 
inclusion  would  result  in  a lower  expected  coat  per  unit  time  than  omission  of 
the  action  or  inclusion  of  some  other  action.  This  parameter  is  introduced  to 
reduce  the  tendency  of  the  model  to  respond  to  some  processes  more  ofte^  than 
the  human  operator. 

The  second  parameter  is  an  upper  probability  threshold.  If,  after  the 
determination  of  an  action  sequence  by  the  concatenation  of  actions  which 
successively  lower  the  expected  cost  per  unit  time  of  the  sequence,  there 
remain  outs5ie  the  sequence  processes  for  which  the  probability  of  an  event 
occurrence  is  greater  than  this  threshold,  these  processes  are  added  to  the 
action  sequence.  Of  these  processes,  that  whose  addition  results  in  the 
smallest  increase  in  the  expected  cost  per  unit  time  Is  added  to  the  sequence 
first.  The  remaining  processes  are  then  added  to  the  sequence  in  the  same 
manner.  This  parameter  is  introduced  to  reduce  the  tendency  of  the  model  to 
respond  to  some  processes  less  often  than  the  huma^  operator. 

There  are,  then,  four  free  parameters  in  our  application  of  the  model  to 
the  experimental  situation  — 0 , specifying  the  relative  weighting  assigned 
to  feature  values  calculated  over  recent  and  older  process  measurements,  the 
cutoff  length,  specifying  the  number  of  measurements  over  which  features  are 
extracted,  and  two  probability  thresholds  used  to  exclude  or  include  actions 
in  the  action  sequence  on  the  basis  of  event  probability  alone. 
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RESULTS 


The  decision  asking  perforasnce  of  the  aodel  ms  coapared  with  that  of  each 
subject  by  supplying  the  aodel  with  the  HTTRs  and  Cs  associated  with  each  of 
the  processes  and  with  estiaates  of  the  a priori  and  a posteriori 
probat ill ties  of  failures  in  each  of  the  processes  at  the  tiae  they  were 
displayed  to  the  subject.  The  aodel  ms  used  to  generate  action  sequences  for 
each  display  viewed  by  each  subject  on  his  last  three  trials  (a  total  of  75 
displays  with  9 processes/display  for  each  si^Ject) - These  action  sequences 
were  coapared  on  a sequence  by  sequence  basis  with  the  corresponding  action 
sequences  entered  by  the  subject. 

In  generating  the  a posteriori  probabilities  of  failures  in  each  of  the 
processes,  6 and  the  cutoff  length  were  fixed  at  intuitively  reasonable 
values  of  0.2  and  10,  respectively.  Ho  atteapt  ms  aade  to  deteraine  the 
values  of  B and  cutoff  length  which  yield  the  best  performance  of  the  aodel 
across  all  subjects.  Although  it  seeas  reasonable  to  conjecture  that  better 
perforaance  could  be  obtained  by  determining  the  optimal  B ^-cutoff  length 
pair  for  each  subject,  our  goal  of  a staple  computer  aiding  scheme  motivated 
the  decision  to  fix  these  parameters. 

In  evaluating  the  model's  perforaance  we  are  concerned  with  two  aspects  of 
decision  asking.  First,  when  did  the  aodel  include  a specific  process  in  its 
action  sequence  and  how  does  the  timing  of  this  action  compare  with  that  of 
the  subject's  response  to  the  process?  Second,  for  those  processes  included 
in  both  the  model's  snd  the  subject's  action  sequences  for  a given  display, 
how  many  of  the  model's  orderings  of  actions  within  the  sequence  differ  from 
the  s\ibject*s  orderings? 

Regarding  the  timing  of  the  aodel 's  responses  relative  to  that  of  the 
subject,  there  is  some  difference  in  the  utility  of  modeling  tnoae  responses 
of  the  subject  to  processes  which  actually  require  service  (hits)  and  those 
responses  to  processes  which  are  not  failed  and  do  not  require  service  (false 
alarms) . He  would  be  particularly  concerned  that  the  aodel  respond  to  those 
processes  requiring  service  that  the  subject  responds  to,  and  would  prefer 
that  the  aodel  ulso  respond  to  these  processes  at  the  sane  time  as  the 
subject.  We  are  less  concerned  with  the  correspondence  of  the  model's  and 
subject's  false  alarms,  provided  the  aodel  does  not  make  more  false  alarms 
than  the  subject. 

Table  1 compares  the  performance  of  the  aodel  with^  the  performance  of  each 
of  the  four  subjects.  In  each  case,  the  lower  and  upper  probability 
thresholds  of  the  aodel  were  varied  to  achieve  the  best  fit  of  the  model's 
perforaance  to  the  subject's  performance.  The  best  fit  was  defined  in  terms 
of  the  difference  of  two  performance  measures:  the  nuaber  of  detections  by 
the  aodel  made  only  at  the  exact  same  time  as  the  subject's  detections  and  the 
number  of  detections  aade  by  the  subject  and  aissed  by  the  model.  The  latter 
measure  was  subtracted  from  the  former  and  the  threshold  was  varied  to 
aaxiaize  the  resulting  quantity.  The  maximization  was  done  subject  to  the 
constraint  that  the  nuaber  of  false  alarms  by  the  aodel  not  exceed  the  number 
of  false  alarms  by  the  subject.  Thus,  we  sought  to  maximize  the  mmiber  of 
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tlaes  thm  aodel  and  subject  responded  to  failed  processes  at  exactly  the  same 
tine.  Ue  sought  to  ■inialae  the  nunber  of  tines  the  nodel  did  not  respond  to 
a failed  process  to  which  the  subject  did  respond  to.  And  we  did  not  penait 
the  aodel  to  make  nore  false  alanas  than  the  subject.  It  should  be  noted 
that,  during  the  experlnental  trials  given  the  subject,  processes  entered  by 
the  subject  for  service  on  a given  iteration  were  serviced  and  reset  to  nonaal 
before  the  generation  of  a display  for  the  next  iteration.  Because  of  this, 
when  we  conpare  the  nodel^s  actions  with  those  of  the  subject,  it  is  not 
possible  for  the  aodel  to  take  action  with  respect  to  a failed  process  on  an 
iteration  later  than  the  one  at  which  the  subject  acted. 


TABLE  1 

Conparison  of  aodel's  perfomance  with  subjects*  perforaance 


Subject 

wm 

Tu 

MIT, 

■aiTsm 

CO 

“"so 

Vk, 

9 

SI 

0.39 

0.60 

110 

97 

85 

13 

17 

17 

S2 

0.63 

0.9« 

117 

109 

92 

8 

28 

27 

S3 

0.32 

0.38 

83 

72 

56 

11 

18 

12 

S4 

0.79 

0.99 

120 

110 

102 

10 

16 

16 

lower  probSbility  threshold 
upper  probability  threshold 

# detections  by  the  subject 

# detections  by  the  subject  also  nde  by  the  oodel 

(at  the  sane  tine  or  earlier) 
i detections  by  the  model  at  the  exact  sane  time 
as  the  subject  and  only  at  that  time 

# detections  by  the  subject  missed  by  the  model 

# false  alarms  by  the  subject 

# false  alarms  by  .he  model 


M,. 

MBIT*  : 


iHIT 


CO* 


■HIT 


HFA 

NFA 


SO- 


S- 


Table  1 reveals  that,  through  the  variation  of  the  threshold  parameters 
alone,  it  was  possible  to  obtain  a high  degree  of  correspondence  between  the 
model's  performance  and  the  performance  of  the  subjects  on  their  last  three 
trials.*  Vithin  the  constraint  that  the  model  make  no  more  false  alarms  than 
the  subject,  the  model  responded  to  90S  of  the  process  failures  responded  to 
by  the  subjects.  It  responded  to  78f  of  the  process  failures  responded  to  by 
the  subjects  on  the  iteration  of  the  subject's  response  and  only  on  that 
iteration.  And,  as  shown,  in  Table  2.  for  those  processes  Included  in  both 
the  model's  and  the  subject's  action  sequences.  only  17  of  the  model's  240 
ordering  decisions  differed  from  those  of  the  subjects. 
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TABLE  2 

Coaparison  of  the  aodel*s  ordering  decisions  with  those  of  the  subject  (for 
responses  ooaaon  to  aodel  and  subject) 


Subject 

SI 

S2 

S3 

S4 

# 

Consistent  decisions 

53 

73 

33 

81 

# 

Inconsistent  decisions 

3 

8 

2 

4 

CONCLUSION 


The  decision  making  niodel  has  been  shown  to  provide  a good  fit  to  data 
obtained  using  a specific  multiple  process  monitoring  situation.  The  use  of 
discriminant  anclysis  to  model  the  human* s generation  of  event  probabilities 
permits  the  model  to  be  used  in  situations  in  which  explicit  models  of  the 
processes  being  monitored  are  unavailable.  It  also  allows  the  model  to  be 
applied  with  relative  ease  to  situations  in  which  specific  event  probability 
estimation  algorithms  are  available,  but  unwieldy.  In  the  application 
described  in  this  paper  the  nature  of  the  events  to  be  detected  resulted  in 
displayed  process  histories  of  a nonstationary  nature.  Four  simple  features 
of  the  process  measurements  were  used  to  discriminate  between  the  presence  and 
absence  of  events.  These  features  were  suggested  by  the  comments  of  subjects 
attempting  to  detect  the  events.  In  providing  the  aodel  with  examples  of  the 
values  these  features  took  on  when  events  were  present  and  absent,  subjects* 
estimates  of  the  event  occurrence  times  were  used  to  define  events. 
Reasonably  good  performance  was  obtained  without  the  availability  of  true 
event  occurrence  times  to  define  events  for  the  model.  Thus,  the  model 
performed  well  despite  the  fact  that  it  only  had  subjects*  qualitative 
descriptions  of  what  events  looked  like  and  when  they  occurred. 

Although  the  model  generally  exhibited  performance  similar  to  that  of  the 
experimental  subjects,  analysis  of  the  ordering  decisions  made  by  the  subjects 
indicated  that  several  of  the  subjects  occasionally  scheduled  actions  with 
respect  to  processes  they  didn't  feel  yet  required  attention.  These  processes 
required  diversion  of  attention  from  other  processes  for  only  a small  amount 
of  time  and  thr~,  permitted  the  subject  to  act  with  little  risk  on  the 
possibility  that  the  processes  might  require  attention  by  the  time  it  was 
available  for  them.  The  model  we  have  presented  allocates  attention  only  to 
processes  for  which  the  probability  of  process  failure  is  above  a threshold. 
It  thus  does  not  model  this  aspect  of  the  subjects*  performance  well. 
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In  this  paper,  we  have  postulated  a aultl-task  situation  In  which  the  huaan 
slaulteneousXy  Bonltors  multiple  dynwlc  processes  for  action  evoking  events. 
The  processes  aay  differ  In  priority  and  the  hueen  cannot  attend  to  all 
processes  slsultaneously.  but  Instead  nust  allocate  his  attention  aaong  the 
processes.  Our  goal  Is  the  development  of  aodels  of  human  decision  making 
aeenable  to  use  In  the  design  end  Implementation  of  a computer  aided  process 
monitoring  system.  This  goal  dictates  several  specifications  for  such  aodels. 
First.  the  aodels  have  to  be  simple  enough  to  Implement  In  a real-time 
environment.  Second,  they  have  to  be  capable  of  adapting  to  changing  process 
dynamics  and  decision  making  criteria.  Finally.  they  would  hopefully  be 
capable  of  learning  the  task  by  * watching*  the  human.  Ue  feel  that  the  model 
proposed  In  this  paper  meets  these  specifications. 

In  this  paper,  the  model  was  applied  to  an  experimental  situation  Involving 
the  monitoring  of  nine  Independent  processes  which  characteristically 
exhibited  only  one  type  of  failure  or  action  evoking  event.  In  applying  the 
model  to  this  situation.  very  little  fitting  of  parameters  to  data  was 
required.  Some  parameters  of  the  model  were  fixed  at  values  considered  to  be 
Intuitively  reasonable.  Features  were  selected  In  similar  fashion,  although 
he  comments  of  other  experimental  subjects  performing  decision  making  tasks 
within  a similar  situation  were  also  Instructive.  TWo  threshold  parameters 
were  varied  to  achieve  a good  fit  of  model  to  subject  In  a situation  Involving 
event  detection  and  attention  allocation  decisions. 

It  Is  clear,  however.  that  the  models  would  have  to  be  extended  and 
validated  for  situations  much  different  from  the  one  to  which  it  has  been 
applied.  The  developmsnt.  for  example.  was  carried  through  assuming 
Independence  among  processes,  an  unrealistic  assumption  in  many  potential 
applications.  In  situations  In  which  some  processes  are  Interdependent,  the 
distributions  of  event  Interarrlval  times  and  action  times  within  these 
processes  might  depend  upon  the  Instantaneous  configuration  of  the 
Interdependent  processes.  While  such  interdependencies  complicate  the  problem 
substantially,  the  general  approach  we  have  proposed  Is  still  applicable. 
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The  approach  and  landing  task  involves  a wide  range  of  human 
behaviors  and  activities,  both  cognitive  and  perceptual-motor. 
These  include  monitoring  and  information-processing,  flight 
control,  decision-making,  execution  of  standard  procedures,  and 
communication  with  other  crew  members  and  with  ATC.  The  goal  of 
the  research  reported  here  was  to  develop  a model  for  this 
complicated  process  that  would  provide  a means  for  systematic 
exploration  of  questions  concerning  the  impact  of  procedural  and 
equipment  design  and  the  allocation  of  resources  in  the  cockpit  on 
performance  and  safety  in  approach-to- landing* 

Given  the  objectives  we  have  for  the  model  and  the  nature  of 
the  issues  we  hope  to  analyze  with  it,  several  general  implications 
for  modelling  the  task  emerge.  First,  it  is  clear  that  a system 
model  is  needed;  one  that  accounts  for  the  interactions  of  crew, 
procedures,  vehicle,  approach  geometry,  and  environment.  Second, 
the  issues  of  interest  revolve  principally  around  allocation  of 
tasks  in  the  cockpit  and  crew  performance  with  respect  to  the 
cognitive  aspects  of  the  tasks.  The  model  must,  therefore,  deal 
effectively  with  information  processing  and  decision-making  aspects 
of  human  performance.  Third,  despite  the  high  cognitive  content  of 
the  approach  task,  a large  portion  of  the  crawl's  activities 
involves  highly  structured,  standard  procedures.  These  must  be 
modelled  at  a level  that  is  adequate  for  determining  how 
performance  on  these  tasks  interferes  with  other  tasks  (and 
vice-versa)  and  for  evaluating  the  consequences  of  failure  to 
execute  important  procedures.  Fourth,  communication  among  crew 
members  and  between  the  crew  and  ATC  must  be  considered  in  the 
model,  at  least  with  respect  to  accounting  for  the  transfer  of 
information  and  the  load  imposed  by  such  communication.  Finally, 
to  ex^unine  the  impact  of  va-^ious  system  conditions  and  assumptions, 
it  roust  be  possible  to  compute  performance  parameters  of  interest. 


♦This  work  was  performed  under  Contract  NAS2-10035.  NASA,  Ames 
Research  Center  sponsored  the  research  with  Dr.  Renwick  Curry  as 
technical  monitor. 
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PROCRU  (Procedure  Oriented  Crew  Model) , Is  a tilmulation  model 
for  examining  crew  procedures  in  approach  to  landing*  developed 
with  the  above  requirements  in  mind.  It  includes  a system  model 
and  a model  for  each  crew  member.  The  crew  is  assumed  to  be 
composed  of  three  members:  pilot  flying  (PF) * pilot  not  flying 
(PNF)  and  second  officer  (SO) . In  the  present  Implementation  of 
PRCJRO*  the  SO  model  does  not  include  any  information  processing  or 
decision-making  components.  Rather*  the  SO  is  modelled  as  a purely 
deterministic  program  that  responds  to  events  and  generates 
requests.  PF  and  PNF*  on  the  other  hand*  are  each  represented  by 
complex  human  operator  models  which  have  the  same  general  form  but 
differ  in  detail. 

Briefly*  PF  and  PNF  are  each  assumed  to  have  a set  of 
"procedures”  or  taslcs  to  perform,  'xlie  procedures  Include  both 
routines  established  "by  the  book"  (such  as  checklists)  and  tasks 
to  be  pe:,  formed  in  some  "optimizing*  fashion  (such  as  flyxng  the 
airplane) . The  particular  task  chosen  at  a given  instant  in  time 
is  the  one  perceived  to  have  the  highest  expected  gain  for 
execution  at  that  time.  The  gain  is  a function  of  mission 
priorities  and  of  the  perceived  estimate  of  the  state-of-the-world 
at  that  instant.  This  estimate  is  based  on  monitoring  of  the 
displays*  the  external  visual  c.v.ene  and  auditory  Inputs  from  other 
crew  members.  PROCRO  draws  heavily  on  the  concepts  and  submodels 
of  the  Optimal  Control  Model  ((X9I)  for  the  human  operator^  for  its 
information  processing  and  control  representation.  However*  there 
at'j  many  novel  aspects  and  features  of  the  model  that  constitute 
n6w  developments. 

In  the  remainder  of  this  paper  we  present  an  overview  of  the 
PROCRO  model  and  some  results  illustrating  its  operation.  More 
details  may  be  found  in  reference  2. 

1.  Model  Description 

The  basic  structure  of  the  PROCRO  model  for  either  PF  or  PNF 
is  illuscrated  in  Figure  1.  The  system  model  is  the  same  for  both 
crew  members  and  is  discussed  first. 

1.1  System  Model 

Vehicle  Dynamics 

The  representation  of  vehicle  dynamics  must  be  sufficient  to 
capture  the  essential  aspects  of  the  task  but  there  is  an  incentive 
(computational  cost)  to  keep  it  as  sisple  as  possible.  Certainly* 
the  equations  of  motion  must  be  adequate  to  describe  the  position 
and  velocity  of  the  aircraft  relative  to  the  nominal  approach  path* 


£89 


but  £oc  the  Issues  to  oe  addressed  b:.'  PROCRO  (at  leasts  initially) , 
linearized  equations  can  be  used  and  inner-loop  (high-frequency) 
dynamics  ignored,  to  a first  approximation.  Thus,  we  use  as  a 
basis  for  the  dynamic  calculations  in  PROCRU  standard  point  mass 
equations  for  the  vehicle  trajectory.^ 

These  equations  may  be  written  in  the  general  form 

X - f (X,U,t)  (1) 

where  X is  the  vehicle  state  vector  and  U is  the  control  input. 

The  scheme  utilized  to  "integrate"  the  above  equations  and  to 
provide  the  linearized  equations  needed  for  implementing  the 
control  and  estimation  portMons  of  PROCRO  is  somewhat  novel  and,  we 
believe,  is  in  keeping  with  the  manner  in  which  approach 
trajectories  are  flown.  Briefly,  five  "nominal  trajectory" 

segments,  corresponding  to  five  standard  maneuvers,  are  defined: 

1)  straight  and  level  flight 

2)  deceleration  at  constant  flight  path  angle 

3)  turn  at  constant  rate 

4)  flare  (constant  rate  of  change  of  flight  pa^h  at  constant 
speed  and  heading) ) 

5)  descend  at  constant  sink-rate 


It  is  possible  to  determine,  algebraically,  for  each  l•^n«.'Jver  the 
"trim"  or  "nominal"  controls  necessary  to  achieve  the  desired 
condition  and,  moreover,  to  integrate  the  corresponding  equations 
of  motion  exactly  to  obtain  ^(t).^  The  equatlo  s can  then  be 
linearized  about  the  particular  segment  to  yield  equations  of  the 
form 


X - ^ X + u 


»i  - 


where 


X(t) 

U't) 


3x1 


+ x(t) 
+ u(t) 


3Uj 


(2) 


(3> 


N,- 


and  the  subscript  Mi  means  that  the  qv  Atity  is  evaluated  along  the 
N^^th  segment. 


We  note  that  it  is  not  necessary  for  a nominal  segment  to 
start  at  a particular  place.  In  addition,  because  the  system 
matrices  change  from  segment  to  segment  (and  from  moment  to  moment 
in  a turn  or  segment),  the  linearized  equations  (3.3)  will  be 
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tiae-varylng  (piecewise  constant)  over  the  approach  trajectory • 
Pinally«  we  aay  generalise  (2)  to  include  wind  and  other  poss'ble 
disturbances  by  rewriting  it  as 

k*  IL*  SHiH.  ♦ 5Mi  “Hi  ♦ ^i^i 

where  w||.  is  a sero^aean  white  noise  with  covariance  1^.  and  is 
a deterBXnistic  disturbance  that  is  unknown  to  the  pilor.  Bquacion 
4 is  in  a forsi  that  is  standard  for  applying  the  OptiBal  Control 
Hodel  (OCM)  of  the  huaan  operator.^ 

SubsysteBS: 

Aircraft  subsysteBSr  such  as  engines,  hydraulics,  etc«,  are 
not  Bodelled  in  any  detail*  Subsystea  operation,  when  required  by 
procedures,  is  accoaplished,  or  not,  as  deterained  by  the  aodels 
for  the  crew* 

ATC  Ooaaunications; 

Air  Traffic  control  vectoring  coaaands  are  preprograaaed  as 
part  of  the  approach  scenario.  They  take  the  fora  of  auditory 
guidance  coaaands,  to  be  processed  and  executed  by  the  PF* 

Instruaent  Landing  Systeat 

The  instruaent  landing  systea  aodel  includes  the  glide  slope, 
localixer,  outer  Barker  and  aiddle  marker*  Coaputed  vehicle 
position  is  used  to  compute  ^activation*  of  any  of  these  ILS 
signals  and  to  determine  glide  slope  and  localiser  errors  in 
*dots*.  The  model  does  not  presently  include  any  beam  errors  but 
these  could  be  added  without  difficulty* 

Information  Sources: 

lie  assume  that  foir  k>aaic  sources  or  "clusters*  of 
information  are  available  w a crew  member  t external  visual  scene 
information,  visual  information  concerning  vehicle  state  from  the 
flight  instruments,  visual  information  concerning  subsystems  and 
audlLory  information* 

The  information  from  the  external  visual  scene  depends  on  the 
position  and  attitude  of  the  aircraft  relative  to  the  airfield* 
Geometric  analysis  allows  us  to  define  how  the  "displayed* 
quantities,  depend  on  vehicle  state  and  scene  content**'^'^ 

The  information  on  the  instrument  panel  can  rel ite  to  vehicle 
status  information  (from  flight  instrumentation) , command 
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infocaation  (ftoa  flight  directors)  and  subsystea  inforaation 
(including  subsystsa  status  and  visual  "alaras*) . The  inforaation 
aay  be  discrete  as  well  as  continuous.  We  assuae  this  inforaation 
is  separated  into  two  clusters*  one  for  vehicle  state  related 
inforatation*  and  one  for  subsystea  inforaation.  For  the 
PROCm)  analysis  conducted  herein*  the  flight  displays  are  assuaed 
to  indicate  air  speed*  heading*  altitude*  rate-of-clisb  and*  after 
beaa  intercept*  localiser  and  glide  slope  error.  The  subsystea 
displays  are  not  aodelled  with  respect  to  inforaation  content  but 
serve  as  an  attention  distraction  or  "sink"  when  a procedure 
requiring  subsystea  operation  is  being  perforaed  (see  below). 

Auditory  inforaation  includes  conaand  inforaation  froa  ATC* 
auditory  alaras*  and  coaaunications  froa  other  crew  ae^>ers  such  as 
callouts,  requests*  etc. 

1.2  Huaan  Operator  Itodels 

The  aodels  for  the  huaan  operator  (PF  or  PWF)  contain 
subaodels  for  aonitoring*  inforaation  processing*  decision-aaking 
(procedure  selection)  and  action.  These  are  discussed  below. 

Monitoring 


The  aonitor  sub-aodel  accounts  for  the  operator's  sensory 
lialtations  as  well  as  for  aonitoring  decisions  (i.e.,  allocation 
of  attention).  The  visual  sensory  lialtations  are  aodelled  in  the 
saae  aanner  as  in  the  (X9I*^*^  except  that  the  perceptual  delay  is 
neglected.  In  particular*  an  observation  noise  and  a threshold  are 
associ«tted  with  each  observed  visual  quantity.  The  thresholds  are 
particularly  iaportant  for  external  visual  scene  perception;  for 
exaaple*  in  liaiting  the  quality  of  available  vertical  guidance 
inforaation. 

Auditory  inforaation  is  assuaed  to  be  heard  correctly.  It  is 
stored  in  a aeaory  buffer  for  subsequent  processing. 

The  opera'-.or  cannot  process  all  sources  of  inforsMtion 
siaultaneously  and  aust*  therefore*  decide  which  source  to  "attend 
to."  In  the  case  of  visual  inforaation  there  is  a fundaaental 
choice  as  to  where  to  fixate*  on  the  external  world  or  on  the 
instruaent  panel.  If  the  instruaent  panel  is  chosen*  the  operator 
oust  de. Ide  upon  which  instruaent  to  fixate.  We  shall  also  assuae 
that  the  auditory  inforaation  siailarly  "coapetes"  with  the  visual 
inforaation  for  operator  attention. 

Thus,  when  auditory  or  subsystea  inforaation  is  requested  by  a 
procedure,  attention  is  diverted  froa  the  flight  displays  and  no 
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infonution  concerning  the  ▼ebicle'e  state  is  obtained  (except  if 
it  cones  via  the  auditory  channel  fron  another  crew  nenber) . Nhen 
flight  di9la3TS  are  being  observed,  either  for  flying  the  airplane 
(for  PP)  or  for  status  nonitoring  (for  PHP) , attention  is  assuned 
to  be  shared  anong  the  displays  on  a continuous  basis  instead  of 
being  restricted  to  a single  di^lay  at  a tine.  PROCRD  eaploys 
sub-optiaal  attention-allocation  algor  iUnw  to  conpute  the 
appropriate  attention-sharing  strategies.^  However,  if  a crew 
nenber  selects  a procedure  that  results  in  a "nonitoring  request" 
for  a given  di^lay  (e.g.,  check  airspeed),  then  the  fraction  of 
attention  corresponding  to  that  flight  di^lay  is  set  to 
(approxinately)  one,  and  the  renaining  attentions  are  set  to 
(approxinately)  mro. 

Information  Processing 

The  information  processor  portion  of  the  model  consists  of  two 
sub-sndels,  an  "estiMtor"  and  a "discrete  event  detector".  The 
estimator  is  identical  to  that  used  in  the  (XU  and  is  a 
tine-varying  Kalman  filter.  The  internal  model  for  the  filter 
changes  with  changes  in  dynamics  resulting  from  alteration  of  the 
"nominal"  or  fron  flap  or  gear  extensions  or  with  changes  in 
disturbance  characteristics. 

The  outputs  of  the  estinator  are  the  estimate  of  the  perturbed 
state,  t,  the  covariance  of  the  estimation  error,!,  and,  perh^s, 
the  innovations  sequence,  and  its  covariance.*  We  will  assuM  that 
the  probability  distribution  for  x is  normal,  in  which  case  x and  £ 
are  sufficient  statistics  for  deteminiiM  the  conditional  jfensity 
of  X based  on  past  observations  y,  P(xfy).  Thus,  the  estimator 
pro^ces  status  information,  t,  needed  for  control  and  "subjective" 
probability  estimates  that  can  be  used  for  decision-making  or 
detection.  Note  that  the  error  covarianc^I,  is  a measure  of  the 
operator's  uncertainty  in  the  estimate  x and  vill  be  a suijor 
factor  in  determining  monitoring  decisions,  as  will  be  seen  below. 

The  discrete  event  detector  is  intended  to  model  those  aspects 
of  operator  information  processing  other  than  vehicle  state 
estimation.  Typically,  it  is  concerned  with  determining  or 
detecting  that  an  event  has  occurred  which  "enables"  a subsequent 
procedure  execution.  The  event  may  be  a failure  (that  did  or  did 
not  result  in  an  alarm) , a request  for  action  (say  from  ATC) , or 
some  annunciated  condition  (e.g.,  crossing  OM,  glide  slope  active 
or,  passing  through  some  altitude).  The  inputs  to  the  event 
detector  are  outputs  of  visual  alarms,  auditory  information,  and 

* In  the  present  implementation  oH  PROCRU,  it  is  assmwd  that  the 
nominal  state  ^(t)  is  known  to  the  crew. 
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th«  outputs  of  ths  stats  sstlstator.  Ths  stats  Inforaatlon  la  ussd 
to  dstsct  stats  cslatsd  svsnts  such  as  a dsstabilissd  approach 
condition. 

Highly  sophlstlcatsd  aodsls  sxlst  for  csctaln  typss  of  fallurs 
dstsctlon  bassd  on  stats  sstlauition,  and  thsss  might  svsntually  bs 
Incocporatsd  In  ths  svsnt  dstsctor  modal.*  Ns  did  not  gst  so 
sophlstlcatsd  Initially.  Instsad#  «cs  assumsd,  sillily,  that  ths 
occutcsncs  of  an  svsnt  is  dstsctsd  with  a spsclflsdt  flnits 
probability  by  ths  crsw.*  Bowsvsr,  ths  naturs  of  ths  svsnt  Is 
assuasd  to  bs  unknown  until  ths  procsdurs  for  dscodlng  SMSsagss 
(sss  bslow)  Is  Invoksd.  Ths  sslsction  of  this  procedurs  can  bs 
dslaysd  by  ths  rsqulrsmants  to  par form  othsr  tasks » thus  daisy ing 
ths  sffsctlvs  tlms  of  svsnt  dstsctlon.  Ones  ths  msssags  assoclatsd 
with  ths  svsnt  Is  dscodsd,  it  will  gsnsrally  rssult  In  ths 
"snabllng*  or  *trlggsrlng*  of  an  approprlats  procsdural  rssponss. 

Procsdurs  Dsf Inltlon  and  Sslsction 


Ths  opsrator  Is  assumsd  to  havs  a numbsr  of  proesdurss  or 
tasks  that  may  bs  psrformsd  at  sach  Instant. 

Ths  dsflnltlon  of  thsss  proesdurss  Is  an  ssssntlal  stsp  In  ths 
formulation  of  PROCRU.  kll  crsw  actions*  sxcspt  for  ths  dsclslon 
as  to  which  procsdurs  to  sxscuts*  ars  dstsrmlnsd  by  ths  proesdurss. 
Ns  smphaslss  that  ws  uss  ths  tsrm  procsdurs  hsrs  to  apply  to  tasks 
in  gsnsrali  a procsdurs  In  thsss  tsrma  could  havs  cons Idsr ably  mors 
cognltlvs  contsnt  than  might  normally  bs  conaidsrsd  to  bs  ths  cass. 

Proc*dur«  Catagorita 

Tabls  1 catsgorlsss  ths  approach  to  landing  flight  proesdurss 
for  ths  PP  and  PNF.  For  sach  erswman,  six  catsgorlss  ars  shown* 
and  for  sach  catsgory*  spsclfic  typss  of  proesdurss  ars  Itsmlssd. 
Ns  brlsfly  discuss  thsss  catsgorlss  and  typss  In  ths  following 
paragraphs. 

Ths  vshlcls  control  proesdurss  asslgnsd  to  ths  PF  ars  broksn 
down  Into  thrss  typss t mansuvsrlng  control*  rsgulatory  control 
and  rstr laming  control.  Ths  first  Involvss  ths  dstsrmlnatlon  of 
approprlats  mansuvsr  ratss*  ssttlng  trim  control  valuss  to  sffset 
thsss  ratss*  and  monitoring  for  mansuvsr  tsrmlnatlon.  In  sffset. 
opsn-loop  mansuvsr  control  provldss  a msans  of  gsnsratlng  ths 
"nominal*  trajsetory  of  Bqn.  3.  Rsgulatory  control*  on  ths  othsr 


* Ths  probability  Ts  chossn  €o  Es  ons  For  bhls  study^  For 
Kiapliclty. 
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handf  involves  monitor Ing  the  display  perturbations  away  froA  the 
i.oainal,  estiaating  the  corresponding  vehicle  state  perturbations, 
and  generating  an  appropriate  perturbation  control  to  control  out 
the  variations.  Closed*loop  regulatory  control  ensures  proper 
execution  of  the  desired  maneuver  and  is  modelled  using  standard 
OCM  techniques^.  Finally,  retrimming  control  provides  a means  of 
re  trimming  the  vehicle  after  a flap  or  gear  setting  change  has 
altered  the  vehicle  trim  conditions. 

The  vehicle  monitoring  procedures  assigned  to  the  PHF  are  also 
broken  down  into  two  types:  sonitoring  for  vehicle  status,  and 
monitoring  for  event  or  failure  detection.  The  former  involves 
determining  an  appropriate  monitoring  strategy  for  attention 
sharing  among  the  available  displays,  estimating  the  corresponding 
vehicle  state,  and  evaluating  the  approach  progress  based  on  the 
current  state  estimate.  The  latter  involves  a similar  process,  but 
is  centered  on  detecting  events  or  failures. 

Requests  and  callouts  made  by  the  PF  and  PHF,  respectively, 
involve  verbal  responses  based  on  estimates  of  current  vehicle 
status.  The  flap,  gear,  and  checklist  requests  made  by  the  PF 
involve  determining  the  vehicle ‘^s  approach  progress  in  terms  of  one 
or  more  trajectory/instrument  parameters,  and  making  the  request 
based  on  the  progress  and  in  accordance  with  a well^ef  ined  set  of 
request  procedures.  The  position  and  altitude  callouts  made  by  the 
PHF  involve  a similar  process.  The  approach  stability  and 
runway-in-sight  (RWIS)  callouts,  also  made  the  PHF,  involve  the 
additional  requirement  of  determining  when  the  vehicle  is  in  an 
appropriate  "window*  for  making  or  not  making  the  callout. 

Subsystem  monitoring  and  control  actions  made  by  both  pilots 
are  assumed  to  be  event  driven,  and  involve  discrete  control 
actions  and/or  diversion  of  attention  from  flight  displays  for 
appropriate  subsystem  servicing.  For  the  PF,  servicing  the 
altitude  alert  subsystem  is  distinguished  from  the  servicing  of  all 
other  subsystems,  because  of  the  interactive  nature  of  setting  the 
trigger  point,  responding  to  the  alarm,  and  resetting  it.  For  the 
PNF,  the  flap  and  gear  subsystems  are  called  out  because  of  their 
impact  on  approach  progress,  their  unique  status  of  being  driven  by 
requests  from  the  PF,  and  because  of  the  need  for  subprocedures 
involving  validation  of  the  request,  and  setting  and  checking  of 
the  subsystem  involved. 

Verbal  acknowledgements  made  by  the  PF  and  PHF  are  driven  by 
checklist  item  prompts  generated  by  the  SO.  These  require  the 
checking  of  an  appropriate  subsystem  (attention-diversion)  and 
making  the  appropriate  verbal  response.  The  PNF  is  also  assigned 
the  duty  of  acknowledging  the  receipt  of  ATC  vector  requests. 
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The  SAP/NAP  teratnal  procedures  provide  for  appropriate 
callouts,  head-up/head-down  switching  strategies,  and  missed 
approach  initiation  during  the  terminal  phase  of  either  the 
Standard  Approach  Procedure  (SAP)  or  the  Monitored  Approach  (NAP) 
Although  this  category  of  proc^ures  could  be  allocatr  item  by 
item  to  the  other  categories,  it  has  been  found  to  be  more 

convenient  to  treat  it  as  a uniform  procedural  category,  both  for 

the  purpose  of  modelling,  and  for  discussion. 

The  miscellaneous  procedures  shown  are  primarily  for  the 

purpose  of  modelling  convenience,  and  are  not  intended  to  directly 
represent  ”by-the-book*  or  actual  procedures  engaged  in  by  the 
crew.  They  include  processing  and  decoding  of  verbal 

communications,  auditory  alarms,  and  discrete  virual  events.  In 
addition,  for  the  PP,  they  involve  selection  of  appropriate  landing 
configuration  parameters. 

Procedure  Salaotion 

lie  assume  that  the  operator  knows  what  is  to  be  done  and, 
essentially,  how  to  accomplish  the  objective.  However,  he  must 
decide  what  procedure  to  do  next.  This  is  a decision  among 
alternatives  and  the  procedure  selected  is  assumed  to  be  the  one 
with  the  highest  expected  gain  for  execution  at  that  time.  The 
Expected  Gain  for  executing  a procedure,  KP,  is  a function  that 
is  selected  to  reflect  the  urgency  or  priority  of  that  procedure  as 
well  as  its  "value*.  In  addition,  the  B6P  can  be  a function  of 
the  "enabling"  state  of  the  procedure.  Thus,  if  a procedure  were 
not  "enabled*  it  would  have  sero  gain  and  would  not  be  chosen;  if 
the  enabling  event  had  a non-sero  probability  of  occurrence,  the 
procedure  night  then  be  selected. 

In  PROCRU,  we  have  assumed  the  EGP  functions  have  the 
following  general  form  (specific  expressions  are  given  in  reference 
2): 


BGP(I)  - G(I)  *Gq{1),  1-1, ...,H  (0) 

where  I denotes  the  Ith  procedure,  G(I)  is  a function  that  reflects 
the  "situational  relevance*  of  the  procedure  and  God)  is  a 
constant  that  depends  on  the  relative  "value*  of  the  prroedure. 
For  procedures  that  are  triggered  by  the  operator's  internal 
assessment  of  a condition  related  to  the  vehicle  state-«'ector , the 
G(H  functions  are  appropriate  subjective  probabilities,  based  on  R 
and  £,  as  determined  by  the  information  processing  portion  of  the 
mod  A.  Procedures  that  are  triggered  by  events  «'xternal  to  the 
operator,  such  as  ATC  commands,  communications  from  the  crew,  etc., 
are  characterized  by  G's  that  are  explicit  functions  of  time.  For 
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either  type  of  function,  the  gain  for  performing  a procedure  will 
increase,  subsequent  to  the  perception  of  the  triggering  event, 
until  the  procedure  is  performed  or  until  a time  such  that  the 
procedure  is  assumed  to  be  "missed*  or  no  longer  appropriate  for 
execution. 

The  Gq  terms  have  tmo  principal  purposes.  First,  they  are 
used  to  establish  a "default”  procedure  for  each  operator  by 
assigning  a base  value  for  S6P  for  that  procedure  that  is  greater 
than  for  any  other  one*  (The  G(I)  for  any  other  procedure  must 
exceed  this  base  value  before  tho  procedure  can  be  selected.)  For 
PF  the  default  is  flying  the  airplane,  whereas  for  the  PWF  it  is 
monitoring  the  vehicle's  status*  The  second  purpose  of  the  Gq  term 
is  to  establish  priorities  among  procedures  that  might  have  the 
same  situational  relevance  at  a given  time. 

Procedures  may  be  comprised  of  a number  of  sub-procedures,  so 
that  at  the  cosqiletion  of  each  sub-procedure,  a decision  to 
continue  must  be  made.  This  will  permit  interruption  of  such  a 
procedure,  depending  on  the  outcome  of  the  decision* 

We  believe  that  this  model  for  procedure  selection  captures 
many  important  aspects  of  human  performance  in  a multi-task 
environment,  and  is  directly  relevant  to  investigating  the  efficacy 
of  flight  crew  procedures*  It  allows  for  proc^ures  to  be  missed 
and/or  interrupted:  even  flying  the  airplane  My  be  neglected,  as 
can  hap  en.  Although  we  do  not  expect  sub-procedural  steps  to  be 
performed  out  of  order  with  this  modelling  approach,  it  would  be 
possible  to  preprogram  such  errors  if  desired* 

Procedure  Execution 

The  selection  and  execution  of  a procedure  will  rv^sult  in  an 
action  or  a sequence  of  actions.  Ihree  types  of  acMons  are 
considered:  control  actions,  monitoring  requests  and 
communications.  The  control  actions  include  continuous  Mnual 
flight  control  inputs  to  the  aircraft  and  discrete  control  settings 
(switches,  flap  settings,  etc.).  Monitoring  requests  result  from 
procedural  requirements  for  specific  inforMtion  and,  therefore, 
raise  the  attention  allocated  to  the  particular  inforMtion  source. 
We  note  that  verifying  that  a variable  is  within  limits  My  not 
require  an  actual  instrument  check,  if  the  operator  already  has  a 
"confident"  internal  estiMte  of  that  variable.  Communications  are 
verbal  requests  or  responses  as  deMnded  by  a procedure.  They 
include  callouts,  requests  or  ccxwsands,  and  communications  to  ATC* 

Associated  with  each  procedural  action  is  a time  to  complete 
the  required  action.  (It  is  possible  to  modify  PRCX^RU  to  allow  for 
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a probabilistic  distribution  of  action  tines).  When  the  operator 
decides  to  execute  a specific  procedure#  it  is  assuned  that  he  is 
"locked  in*  to  the  appropriate  node  for  a specified  tine.  For 
exaaple,  if  the  procedure  requires  "checking"  a particular 
instrunent  and  it  is  assuned  that  it  takes  t seconds  to  acconplish 
the  check,  then  the  "nonitor*  will  not  attend  to  other  infornation 
for  that  period,  nor  will  another  procedure  be  executed. 

In  PROCRn  procedural  iaqplenentation  is  nodelled  as  essentially 
error  free.  However,  errors  in  execution  of  procedures  can  occur 
because  of  inproper  decisions  that  result  fron  a lack  of 
infornation  (quantity  or  quality)  due  to  perceptual,  procedural  and 
workload  linitations.  If  the  effects  of  action  errors  are  also  to 
be  analysed,  this  is  acconplished  by  deliberately  inserting  such 
errors  directly  into  the  nodel.  It  should  also  be  pointed  out  that 
verbal  connunication  is  nodelled  directly  as  the  transfer  of  either 
state,  conaand  or  event  inforsuition. 

2.  Model  Outputs 

PROCRO  generates  a nunber  of  outputs  that  are  useful  for 
analyzing  crew  procedures  and  perfornance.  First,  one  can  obtain 
full  trajectory  infornation.  This  inforsuition  is  provided  at  any 
tine  in  terns  of  the  total  state  (TSTATE  xt)  (and/or  the  noninal 
state)  and  the  perturbation  or  deviation  (DSTATE  x)  fron  the 
noninal.  In  addition  to  this  infornation,  one  can  obtain  each  crew 
nenber's  estinate  of  the  state  (xh)  and  the  standard  deviation  of 
the  estination  error  (SDEV) , the  attentlonal  allocation  (AT)  at 
that  tine  and  PF"s  control  inputs  (u) . These  data,  along  with 
significant  events,  etc.,  are  tabulated  in  a file  as  illustrated  in 
Figure  2.  PF  is  crew  snnber  1 and  PNF  crew  nenber  2. 

In  addition  to  the  trajectory  output,  PROCRO  provides  three 
separate  tine  lines:  a procedural  tine  line  (PTL) , a nessage  tim 
line  (HTL) , and  a nilestone  tine  line  (TL) . Table  2 lists  the 
anenonics  used  for  these  tine  lines.  The  procedural  tine-line, 
illustrated  in  Figure  3 for  the  noninal  approach  conditions, 
provides  a listing  of  the  procedures  (PR(X:)  being  executed  by  each 
crew  nenber,  the  gain  for  doing  that  procedure  (EGP)  and  the 
infornation  cluster  and  display  being  attended  to  at  a given  tine. 
Also  provided  for  each  crew  nenber  is  the  procedure  that  has  the 
next  highest  gain  for  execution  at  that  tine.*  Thus,  for  exanple, 
at  tine  915.4  seconds,  PF  was  flying  on  instrunents  (scanning)  and 
no  other  procedures  were  conpeting  for  attention.  At  the  sane 


^ Procedure  nunber s used  In  EEe  PTL  correspond  Eo  ihbse  In 
reference  2,  Table  4.20. 
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timer  PNF  WAS  monitoring  the  altimeter  in  order  to  make  an  altitude 
callout  (at  t>919.6)f  vhile  the  default  monito«^ing  task  was  the 
task  with  the  next  highest  priority.  Shortly  thereafter  (920.8 
sec)  r PP  diverts  attention  from  regulating  about  the  nominal  to 
process  the  callout  and  PNF  has  reverted  to  basic  monitoring. 

The  message  time  line  (NTL)  is  a record  of  all  the 
communication  traffic  and  auditory  signals  that  occur  in  the 
simulated  cockpit.  Figure  4 is  a message  tlmt  line  for  ahe  nominal 
approach.  The  type  of  message  (Signal  name)#  the  source  of  the 
message  and  its  destination,  its  processing  status,  its  time  of 
origin  and  processing,  as  well  as  an  indication  of  the  signal 
content  are  all  presented  using  mnemonics  that  are  fairly 
transparent*  For  example,  on  the  message  time  line,  we  see  the 
communication  activity  noted  above.  The  500^  altitude  callout  is 
made  by  the  F/0  (PNF)  at  919.6  seconds  and  directed  to  the  CAPT 
(PP)  • It  is  processed  (i.e.  used  to  update  PF's  altitude  estimate) 
at  921.0  seconds. 

The  milestone  time  line  (TL) , illustrated  in  Figure  5, 
contains  selected  trajectory  variables  of  Interest  (altitude,  speed 
and  heading) , an  indication  of  crew  activity  and  a listing  of 
important  flight  milestones  and  events.  Note  that  the  time  marker 
given  in  the  TL,  t^Q,  is  the  time-to-go,  cosputed  simply  as  980s 
minus  the  event  time.  This  provides  a fair  approximation  to  the 
actual  time-to**-go. 

3 • An  Example 

The  milestone  time  line  in  Figure  5 presents  an  overview  of 
crew  activity  for  a nominal  and  even-paced  approach  and  will  be 
discussed  in  detail. 

The  time-line  begins  with  the  vehicle  at  10,000  ft  altitude, 
on  a 210  deg  heading,  proceeding  at  190  kts.  In  the  first  50 
seconds,  three  ATC  requests,  for  a heading  change,  deceleration, 
and  descent,  are  processed  by  both  the  PF  and  PNF.  As  shown  in 
both  Figure  5 and  Figure  4,  each  request  involves:  a)  a message 
generated  by  ATC  sent  to  both  the  PF  and  PNF;  b)  message  processing 
by  the  PF,  resulting  in  a new  maneuver  (e.g.,  *Prcsd  Turn*);  and  c) 
message  processing  by  the  PNF,  resulting  in  a verbal  confirmation 
of  the  ATC  request  (e.g.,  *ATCcn*) . Note  that  Figure  4 shows  that 
each  confirmation  message  (from  PNF  to  ATC)  is  ignored  by  ATC, 
since  the  ATC  module  used  in  this  simulation  operates  in  a 
time-locked  open-loop  fashion.  Naturally,  a more  sophisticated 
module  would  take  into  account  the  procedural  activity  of  ATC,  and 
incorporate  the  verbal  confirmatory  feedback  provided  by  the  crew. 
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The  descent  request  Bade  by  ATC  at  tgq  " 930s  triggers  a 
number  of  crew  activities.  As  just  notedr^it  triggers  a verbal 
confirmation  by  the  PNF.  It  also  triggers  the  generation  of  a 
three-segment  maneuver  (flare/descent/flare)  by  the  PF»  in 
accocfance  with  the  procedure  defined  for  such  a maneuver.  Thusr  a 
flare  to  -S  deg  flight  path  is  initiated  at  tgo  ■ 926s»  and 
constant  sink  rate  is  maintained  until  tg^  ■ 707s,  at  which  point  a 
flare-out  is  initiated,  and  completed  at  tgo  “ 676s.  The  ATC 
descent  request  also  triggers  an  altitude  alert  setting  by  the  PF 
("AAon"  at  tgo  • 922s) . 

As  the  vehicle  approaches  the  requested  3500  ft  altitude,  the 
PF  makes  a verbal  request  for  the  initial  approach  checklist 
("lACR”  at  tgo  “ 686s)  which,  as  shown  by  Eigure  4,  is  processed  by 
the  S/0  at  294s.  This  then  Initiates  the  series  of  lAC  prompts 
by  the  S/0,  shown  in  the  next  few  minutes  of  the  tism-line.  Bach 
such  prompt  (e.g.,  "lAC  1”  at  tgo  ■ 666s  ) results  in  a 
requirement  on  the  PF  or  PNF  to  process  that  prompt  (e.g.,  "Procsd 
lAC  1"  at  tgo  ■ 663s) , and  verbally  echo  the  prompt  back  to  the 
S/0.  Subse<^ent  processing  of  the  confirmation  by  the  S/0  (e.g., 
"Prcsd  lACXl”  at  tgo  “ 659s) , Initiates  generation  of  another 
prompt  by  the  S/0  fe.g.,  *XAC  X2"  at  tgo  - 639s).  The  lAC  is 
concluded  at  tgo  ” S33s  by  a ”IACfn"  message  generated  by  the  S/0. 

The  descent  to  3500  ft  also  triggers  the  altitude  alert  (AA) 
subsystem.  Thus,  h ■ 4019  ft  the  AA  becomes  active,  which 
requires  the  rF  to  turn  it  off  at  tgo  “ 709s,  which,  in  turn 
deactivates  the  AA  at  the  next  time  step  in  the  simulation.  Note 
that  this  occurs  prior  to  the  flare-out  initiated  by  the  F,  thus 
providing  an  appropriate  warning  to  begin  the  flare-out. 

After  the  PF  levels  off  near  the  requested  3500  ft  altitude, 
ATC  requests  a deceleration  to  160  kt.  As  before,  this  triggers  a 
maneuver  by  the  PF  and  a message  confirmation  by  the  PNF.  Note 
that  completion  of  this  maneuver  triggers  a 5 deg  flap  request  by 
the  PF  (tgo  “ 656),  in  accordance  with  the  flap/speed  management 
procedures. 

Following  an  ATC-requested  turn  to  180  deg  (tgq  ■ 540s) , a 
second  descent  to  2000  ft  is  initiated  (tgo  ■ 498s) . The  same 
activity  sequence  is  followed  as  in  the  first  descent,  except  that 
ATC  makes  a 120  deg  turn  request  (tgo  ■ 4S0s)  while  the  vehicle  is 
descending.  The  message  is  processed  by  both  crew  members  (as 
shown  in  Figure  4) , and  confirmation  is  provided  by  the  PNF.  The 
PF,  however,  does  not  act  on  this  request,  but  merely  stores  it  in 
his  memory.  Once  he  levels  off  to  the  requested  2000  ft  altitude 
(tgo  ■ 383s),  he  then  immediately  initiates  the  turn  to  120  deg. 
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As  in  the  initial  descent,  the  PP  requests  the  checklist 
during  his  levelling  off  to  his  assigned  altitude  ("PACK”  at  tgo  ■ 
390s)  . Again,  this  initiates  a series  of  S/0  prompts  and  PP%nd 
PNF  confirmations,  lasting  until  checklist  termination  by  the  S/0 
("PACfn"  at  tgo  ■ 183s). 

While  the  PP  is  turning  to  the  requested  120  deg  heading,  ATC 
notifies  the  crew  that  they  are  cleared  to  land  (tgo  “ 37Ss) . This 
message  is  processed  by  both  the  PP  and  PNP,  and  "enables”  a series 
of  velocity,  altitude,  and  heading  management  procedures  designed 
to  ensure  proper  touchdown  performance. 

The  first  of  these  is  a deceleration  to  ISO  kt,  following 
completion  of  the  turn  to  120  deg  (tgp  “ 363s)  . Once  this  speed  is 
reached,  15  deg  flaps  are  requested  and  set,  by  the  PP  and  PNP 
respectively  (tgn  ■ 349s) . Shortly  thereafter,  the  localizer 
becomes  active,  which  results  in  an  announcement  by  the  PNP,  which, 
in  turn,  triggers  a turn  to  final  by  the  PP. 

During  the  turn,  the  glide  slope  becomes  active  (tgo  ■ 326s), 
and  is  announced  by  the  PNP.  After  the  turn  is  cosq^eted,  the 
vehicle  has  achieved  its  final  inbound  heading,  with  a small 
localizer  error  (not  shown  on  the  time-line).  Shortly  thereafter, 
a 2 dot  low  glide  slope  error  (also  not  shown),  triggers  a 
gear-down  request  from  the  PP,  which  is  acted  on  by  the  PNP  (too  * 
273s) . ^ 


As  the  vehicle  approaches  the  glide  slope,  the  PP  initiates 
two  decelerations  in  accordance  with  the  velocity  maneuver 
procedures,  one  to  140  kt  at  1.5  dots  low,  and  the  second  to  the 
final  approach  speed  of  139  kt,  at  1 dot  low.  Bach  of  these 
trigger  new  flap  requests  and  settings  (to  25  and  30  deg)  in 
accordance  with  the  flap/speed  management  procedure. 

When  the  vehicle  is  0.5  dots  below  the  glide  slope,  the  PP 
Initiates  a pitch  down  (tgo  “ 218s) * This  flare  sets  up  the  final 
descent  follo%red  for  the  remainder  of  the  approach. 

During  the  descent,  the  PNP  announces  OM  activity  ("ONann"  at 
tgo  ” 151s) , and  makes  the  required  1000  ft,  500  ft,  and 
"approaching  minimum”s  (300  ft)  callouts.  He  is  also  monitoring 
O'  t-the-window,  and,  with  the  250  ft  ceiling  simulated,  makes  the 
appropriate  RWIS  callout  at  tgo  ■ 35s. 

While  the  PNP  is  monitoring  for  this  RWXS  callout,  the  MM 
alert  sounds,  and  both  pilots  process  this  message.  The  PNP  should 
announce  MM  activity  during  this  time,  but  is  engaged  <n  monitoring 
the  altimeter  for  his  required  "minimums"  callout  at  200  ft.  Be 
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makes  the  altitude  callout  slightly  early  (at  h«215ft  and  tgo  ■ 
31s) , and  by  the  time  he  can  attend  to  making  the  MN  announceamnt, 
the  MM  becomes  inactive  (at  tgo  “ 30s) . Since  the  announcement 
procedure,  as  programned,  re<^ires  the  MM  to  be  active  for  an 
announcement  to  be  made,  the  PNF  remains  silent. 

The  PP  begins  decelerating  to  the  required  threshold  speed  of 
134  kt  slightly  early  (at  tgo  “ 26s)  and  10  ft  above  the  ISO  ft 
altitude  specified  for  the  nominal  approach.^  The  final  flare  is 
initiated  about  1 sec  late  and  10  ft  below  the  SO  ft  altitude 
desired  for  the  maneuver.  During  this  flare  the  GS  signal  turns 
off  because  of  the  flare  away  from  the  glide  slope  beam,  and  the 
LOG  signal  turns  off  at  touchdown,  as  required  by  the  LOC 
characteristics  modelled  in  this  simulation. 

The  time-line  just  discussed  can  be  correlated  with  the  other 
outputs  of  PROCRU  to  provide  a fairly  detailed  look  at  the  landing 
approach.  Though  the  particular  approach  just  simulated  was 
relaxed  in  tenq>o,  it  is  clear  that  more  desMnding  scenarios  can 
also  be  studied.^  For  these  cases,  where  the  demands  of  the  task 
and  the  procedures  and  equipment  employed  interact  in  complex  and 
significant  ways,  a model  of  PR0CRU''s  breadth  should  prove  most 
useful. 

4.  Concluding  Remarks 

PROCRU,  a new  simulation  model  for  analysing  crew  procedures 
in  approach  to  landing,  has  been  described.  The  model  is  a system 
model  that  can  account  for  vehicle  dynamics,  environmental 
disturbances  and  crew  activities  in  information  processing, 
decision  making,  contt  . and  communication.  Crew  sub-tasks  are 
defined  based  on  a time-line  analysis  of  nominal  procedures. 
Information  processing  and  control  behavior  is  modelled  after  the 
approach  utilized  in  the  Optimal  Control  Model.  Decision  making 
behavior  is  based  on  maximising  subjective  expected  gain.  The 
result  is  a complex,  stochastic  model  for  analyzing  the  impact  on 
approach  and  landing  of  system,  procedure  and  crew  variables. 

The  PROCRU  model  has  not  been  validated  experimentally,  though 
the  information  processing  and  control  parts  of  it  have  been  tested 
for  manual  control  experiments.  IM  addition,  for  this  initial 
implementation,  several  important  aspects  of  human  behavior  have 
been  simplified  or  neglected.  Nonetheless,  it  is  likely  that  even 
in  its  present  state  of  development,  with  some  upgrading  of  wind 
models  and  vehicle  dynamics,  PROCRU  could  be  used  to  analyze  many 
questions  of  interest  regarding  procedures  for  approach  and 
landing. 
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Fiqurs  2;  Sainple  PPOCRU  Trajectory  information  File  (case  ILS) 


***  TIME-  S.816B+02  *** 

Tstate  xt.  1.489B404-8.619B+04  2. 0916^03  1.599B*02  1.799E«02-2.942B  00 
Dstate  x:  ' i78B-01  3.20SE-01  I.832E-0I-8.564E-02-7.831E-02  3.503E-02 

xhl  klk:  >«3B+00  1.221B4-00-2.772B-0I  1.923B-02  5.370B-02-2.S96B-02 

xh2  k|k:  9.636B-01-3.556B4-00-4.20IB-0L  5.574B-02-7.441B-03  3.323B-02 

SOevl  klk:  1.2S1B>02  L.092B4-02  7.846E+00  1.97IB-01  3.031B-01  8.459E-02 

SDev2  k|k:  1.227B-f02  1.081B-I-02  5.643B4-00  2.192B-0I  2.7S3B-01  1.084E-01 

ATI:  V:  .015  PSI:  .240  Bt  .010  Hdot:  .713  LOG:  .010  GS:  .010 

AT2:  V:  .086  PSI:  .629  H:  .112  Rdot:  .153  LOG:  .010  JS:  .010 

Altitude  Alert  Activ« 

GUIDE:  " Executing  FLARE  to  O.OOOE-t-OO  deg  at  2.001B-01  deg/s.  * 

Total  u:  -8.950E  02  2.574B4-00  9.398E-I-03  Flaos-  5.  Gear  is  UP 


***  TIME-  5.818B+02 

Tstate  xt:  1.483B4-04-8.619B^04  2.088B4-03  1.599E>02  I.799E-t-02-2.864Bl-00 
Dstate  x:  1.605E-C1  3.879B-0I  2.360E-01-1.082B-01-6.467B-02  7.293B-02 

xhl  klk:  1.260E+00  1.172B+00-2.823B-01-4.249B-04  5.151B-02  1.534B-02 

xh2  k|k:  1.432B4-00-5.007B+00-1.348B-01  1.177B-02  4.980B-02  6.501B-02 

SDevl  klk:  1.251B+02  1.092B-^02  7.847E+00  1.972B-01  3.080B-01  8.745E-02 

SDev2  k|k:  1.227E+02  1.081B-f02  5.644E4-00  2.192B-01  2.753B-01  1.085B-01 

ATI:  V:  0.000  PSI:0.000  H:  0.000  Hdot:0.000  LOG:0.000  GS:  0.000 

AT2:  V:  .086  PSI:  .628  Hr  .112  Hdot:  .154  LOG:  .010  GS:  .010 

*****  Altitude  Alert  Inactive  ***** 

GUIDE:  " Executing  FLARE  to  O.000B4-O0  deg  at  2.001B-01  deg/s  " 

Total  u:  -8.586B-02  1.955B*00  9.502E4-03  Flaps-  5.  Gear  is  DP 

***  TIME-  5.820B-I-02  *** 

T:.  ate  xt:  1.478B4-04-8.619B+04  2.086B*03  1.599B4-02  1.799B*02-2.852E4^00 
Dstate  x:  1.955B-01  4.469B-01  2.933E>01-9.887E-02-6. 040B-02  4.449B-02 

xhl  klk;  1.258B*00  1.124B+00-2.789E-01  1.015B-02  4.942E-02-7.86IE-03 
xh2  k|k:  1.234B*00-4. 4048*00-2. 945B-02  1.631B-02  2.03IE-02  5.046B-02 

SOevl  klk:  1.252E+02  1.092E*02  7.8488*00  1.972B-01  3.1288-01  9.0218-02 

SDev2  k|k:  1.2278*02  1.0818*02  5.6448*00  2.192B-01  2.753B-01  1.085E-01 

ATI:  V:  0.000  PSI:0.000  H:  0.000  Hdot:0.000  LOG:0.000  GS:  0.000 

AT2:  V:  .086  PSI:  .628  H:  .112  Hdot:  .153  LOG:  .010  GS:  .010 

GUIDE:  * Executing  FLARE  to  0.0008*00  deg  at  2.0018-01  deg/s  " 

Total  u:  -8.236E-02  2.3018*00  9.606E*C3  Flaps-  5.  Gear  is  UP 
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Figure  3 (cont.) 
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Figure  4:  Sample  PRCXIRU  Message  Time-Line  (case  ILS) 
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Figure 

4 tcont.) 
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Figure  5 : 


Sample  PROCRD  Milestone  Time-Line  (Case  ILS) 


TINE  VEHI(a.E  STATE  CREIT  ACTIVZTT  FLIGBT  NILBSTQHBS 

TGo  Alt  Vel  Head  Captain  FOfficec  SOfficer 
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Figure  5 (cont.) 
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Figure  5 (cont. ) 
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Figure  5 (cont.) 
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Figure  5 (cone.) 
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Figure  5 (cont.) 
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Figure  5 (cont.) 
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Table  1:  PF  and  PNF  Procedures 


PF 


1 • Vehicle  Control  Procedures 

a)  Maneuver 

b)  Regulate 

c)  Retrim 

2.  Request  Procedures 

a)  Flap  request 

b)  Gear  request 

c)  Checklist  initiate  requesi; 

3 . Subsystem  Procedures 

a)  Alultude  alert  monitor/ 
cont^  ol 

b)  Misc*  ^ubsy5tem  monitor/ 
control 


4 .  Acknowledgement  Procedures  j 

a)  Checklist  item  acknowledge- 
ment I 


5 . SAP/MAP  Terminal  Procedures 

6.  Miscellaneous  Procedures 

a)  General  message  processing 

b)  Landing  parameter  selection 


PNF 

1.  Vehicle  rionitor  Procedures 

a)  Vehicle  statui  determination 
h)  Failure  detection  and 
identification 

2.  Callout  Procedures 

a)  Velticle  position  callout 

b)  Altitude  callout 

c)  Apnroach  stability  callout 

3.  Subsystem  Procedures 

a)  Fl5»p  monito^/control 

b)  Gear  noni tor/control 

c)  Misc,  subsyst^ici  monitor/ 
control 

4.  Acknowledgement  Procedures 

a)  Checklist  item  acknowledge- 
ment 

b)  ATC  request  acknowledgement 

5.  SAP/MAP  Terminal  Procedures 

6 . Miscellaneous  Procedures 

a)  General  message  processing 


518 


OF  Po, 


i 


- 

QUMLiTY 


Table  2:  Mnemonics  for  Tine  Lfnes 


FlapR 

GearR 

OCR 

lACR 

FACR 

OMA 

LOCA 

Gs  IpA 

AltCo 

AppOs 

RwisC 

ATCcn 

DC»1 

lACil 

IAC*2 

1AC#3 

IAC»4 

liCtS 

FACIl 

FAC»2 

PACI3 

FAC*6 

SBck 

SBSon 

Flaps 

Gear  0 

ILLon 


Flap  request 
Gear  request 

Begin  descent  checklist  request 

Begin  initial  approach  checklist  request 

Begin  final  approach  checklist  request 

Outer  marker  active  callout 

Localize n capture  callout 

Glide  slope  alive  callout 

Altitude  callout 

Approach  destabilization  callout 

Runway  in  sight  callout 

Confirmation  of  ATC  msg. 

Descent  checklist  item  #1 
Initial  approach  checklist  item  fl 
Initial  approach  checklist  item  #2 
Initial  approach  clecklist  item  f3 
Initial  approach  checklist  item  #4 
Initial  approach  cheCis.list  item  IS 
Final  approach  checklist  item  fl 
Final  approach  checklist  item  #2 
Fi.ial  approach  checklist  item  f3 
Final  approach  checklist  item  #6 
Speed  brakes  armed  - check. 

Seat  belt  sign  on  announcement 
Flaps  set  announcement 
Landing  gear  down  announcement 
Inboard  landing  lights  on  announcement 
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Table  2:  (Cont. ) 


SBarm 

MSSon 

ASon 

GPWon 

AAon 

AAoff 

LOCon 

GSon 

OMon 

MMon 

GPWSa 

AltAl 

Decel 

Turn 

Flare 

ChAlt 

DCst 

lACst 

FACst 

DCfn 

lACfn 

FACfn 

ClrFl 

CIgON 

iMMa 

ChgRl 


Speed  brakes  armed  announcenent 
No  smoking  sign  on  avmouncenent 
Anti  skid  on  announcement 

Ground  proximity  warning  system  on  announcement 

Altitude  ale^i:  on  announcenent 

Altitude  alert  off  announcement 

Localizer  on 

Glide  slope  on 

Outer  marker  on 

Middle  marxer  on 

Ground  proximity  warning  system  alert  on 

Altitude  alert  on 

Decel  command 

Turn  command 

Flare  conmand 

Chanqm  Altitude  command 

Starting  descent  checklist  announcement 

Starting  initial  approach  checklist  announcement 

Starting  final  approach  checklist  announcement 

Finished  descent*  checklist  announcement 

Finished  initial  approach  «*;hecklist  announcement 

Finished  final  approach  checklist  announcement 

Cleared  for  landing  announcement 

Continuous  ignition  on  announcement 

Middle  marker  active  callout 

'’taking  control*  announcement 
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A MODEL  FOE  REAL-TIME  HMEM  DECISION-MEEIMG  IN  A HJLTI-TASE  EMVIIOmENT 

^ F.  Erishna-Eao 
Arye  R.  EphrAth 
DAvld  L.  EleioM^ 


Th«  UnivArslty  of  CoimctcclcttC 
Storrs,  Connecticut  06268 « USA 

• ABSTRACT 

A domlnent  thrust  in  future  ■■n-ntchine  systeas  appears  to  be  away  froa  aanual 
control  to  partial*  if  not  full*  autoaatlon.  In  this  direction*  the  role  of  the 
huaan  operator  is  shifting  froa  that  of  a direct  sys tea  controller  to  one  of  a 
aonitor  of  aultlple  tasks*  or  a supervisor  of  several  seai-autoaated  subsystcas. 

The  operator's  priaary  task  In  these  systeas  is  to  extract  ixiforaation  froa  his 
environaent  and  integrate  it  for  action  selection  and  iapleacntation.  However*  the 
tuaan  brings  to  the  aan-a»chine  systea  various  inherent  liaitations*  such  as  reaction 
^ lae  delays*  liaited  resolving  power  and  randoaness*  that  liait  his  ability  and 
degrade  the  overall  systea  perforaance*  In  order  to  properly  analyte  and  evaluate 
a aan-aachine  systea*  a clear  understanding  of  huaan's  capabilities  as  a real-tiae 
decision  aaker  is  Indispensable. 

The  pre:;ent  research  has  sought  to  understand  htiaan  decision-asking  and  task 
selection  procedures  in  dynamic  aulti-task  environment.  The  approach  has  been  to 
assimilate  the  results  of  a Joint  experimental  and  analytic  program  into  a normative 
cptimal  decision  moo«l  (ODM)  for  predicting  human  task  sequencing  performance.  To 
this  end*  a general  multi-task  paradigm  is  developed  wherein  tasks  of  different 
value  (priorily),  dt  ^ation  (processing  time)*  and  deadline  (opportunity  window) 
compete  for  the  attention  of  the  human  operator.  This  is  the  type  of  situation 
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the  hvruui  operator  encoimtera  in  AAA.  tart^t  select ioa,  Alr^ traffic  control*  eultl- 
targetting*  production  scheduling*  etc. 

The  optinal  decision  nDdel  (ODH)  consists  of  two  separable  blocks:  information 
processor  and  decision*maker.  the  information-processor  estinates  the  statistics 
of  the  'decision  state*  which  provides  the  conplete  running  sumsery  of  past  actions 
and  estimates,  these  estimates*  along  with  the  task  values*  are  used  in  a myopic 
decision  strategy*  based  on  semi-Markov  decision  process  (SMDP)  formulation*  to 
obtain  optimal  decisions.  A novel  feature  of  our  modeling  approach  is  that  it 
explicitly  incorporates  human  limitations  into  the  information-processing  and 
decision-making  stages.  The  model  can  be  exercised  either  in  a sample-path  or  in 
a covariance  propagation  mode. 

The  data  are  obtained  using  human  subjects.  The  model-data  validation  effort 
consisted  of  comparing  (1)  the  probability  of  acting  on  e task  at  time  t;  (ii)  the 
probability  of  completing  a task  by  time  c;  (ill)  the  incremental  reward  earned  at 
time  t;  (iv)  the  accumulated  reward  earned  by  time  t;  and  (v)  the  probability  that 
the  human  coaits  an  error  (i.e.*  starts  on  a task  he  can  not  complete).  Excellent 
model-data  agreement  was  obtained  for  several  experimental  conditions. 
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APPLICATION  OF  OPTIHAL  CONTROL  PRINCIPLES  TO  DESCRIBE  THE 
SUPERVISORY  CONTROL  BEHAVIOR  OF  AAA  CREW  MEMBERS 

Chris  E&le 

Systems  Research  Laboratories*  Inc« 

Daytoa,  Ohio 

Capt.  George  J.  Valentino 
Air  Force  Aerospace  Medical  Research  Laboratories 
Uright-Patterson  AFB*  Ohio 

ABSTRACT 

Supervisory  decision  naklng  and  control  behavior  vithin  a C^  oriented* 
ground  based  weapon  systen  is  being  studied.  The  program  involves  empir- 
ical investigation  of  the  se^^uence  of  control  strategies  used  during  engage- 
ment of  aircraft  targets.  An  engagement  Is  conceptually  divided  into 
several  stages  which  include  initial  Information  processing  activity, 
tracking*  and  ongoing  adaptive  control  decisions. 

Following  a brief  description  of  model  parameters*  two  experiments  which 
served  as  initial  investigation  into  the  accuracy  of  assumptions  regarding 
the  importance  of  situation  assessment  in  procedure  selection  are  outlined. 
Preliminary  analysis  of  the  results  upheld  the  validity  of  the  assumptions 
regarding  strategic  information  processing  and  cue-criterion  relationship 
learning.  These  results  indicate  that  this  model  structure  should  be 
useful  in  studies  of  supervisory  decision  behavior. 

INTRODUCTION 

Principles  of  an  optimal  control  model  aro  currently  being  applied  in  the 
study  of  supervisory  decision  processes  in  a simulated  AAA  setting.  The 
control  model  currently  being  developed  in  our  program  at  AFAMRL  is  divided 
into  three  major  stages;  a display  processor*  an  information  processor*  and 
a procedure  processor.  A diagram  of  the  model  organization  is  given  In 
Figure  1.  In  the  display  processing  stage*  certain  display  components  are 
selected  and  differentially  weighted  to  yield  a subjectively  optimized 
display  for  further  evaluation.  The  Information  processor  then  uses  this 
display  subset  to  generate  a current  estimate  of  system  state  and  to  detect 
specific  events  wh^ch  may  influence  subsequent  system  operation.  Finally* 
the  procedure  processor  selects  an  appropriate  procedure  based  on  the 
combination  of  system  state  and  detected  events*  and  implements  that  proce- 
dure verbally  and/or  manually.  This  procedure  selection  is  the  stage  which 
we  are  primarily  interested  in  investigating. 

We  are  currently  concentrating  our  efforts  on  the  operation  of  what  %re  feel 
is  the  major  aspect  of  procedure  selection;  the  situation  assessment  process. 
This  Is  considered  to  be  of  major  importance  because  the  tactical  decisions 
concerning  system  operation  are  based  on  the  outcome  of  this  process. 

Figure  2 depicts  a flow  chart  description  of  the  selection  of  a system 
operating  node.  Inspection  of  this  figure  reveals  the  importance  of  the 
situation  assessor  in  this  process.  State  estimate  and  event  information 
enter  the  assessor  from  the  Kalman  filter.  A perceived  situation  Is  output 
and  this  serves  as  data  in  subsequent  processes.  An  outcome  computer  esti- 
mates and  p^  for  each  mode  alternative.  Each  of  the  modes  is  then 
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assigned  a weight  or4  the  basis  of  expected'  utility » and  the  decision  naker 
selects  the  aost  optioal  mode  based  on  this  aeasure. 

One  of  Che  aajor  tasks  engaged  in  by  the  AAA  coaaander  in  assessing  a 
situation  is  the  learning  of  the  variety  of  relationships  that  exist  between 
the  display  subset  associated  with  an  Incoming  target  and  his  system's 
probability  of  successfully  engaging  that  target.  The  information  upon 
which  these  relationships  depend  is  usually  probabilistic » and  often  incom- 
plete  or  contradictory.  It  Is  critical  that  strategies  which  allow  accurate 
predictions  of  target  behavior  be  developed  quickly.  The  development  of 
such  strategies  can  often  be  impeded  for  two  reasons.  First,  as  mentioned 
above,  is  the  probabilistic  nature  of  the  available  data.  Second,  the  value 
of  Che  available  information  is  usually  not  constant.  Since  information  is 
differentially  valuable,  the  absence  of  certain  types  of  information  from  a 
total  display  may  be  more  damaging  to  rapid  and  efficient  control  perfor- 
mance than  the  absence  of  other  types  of  information.  Two  experiments  were 
conducted  to  explore  the  implications  of  these  two  assertions. 

EXPERIMEKT  I 

One  way  of  rapidly  and  efficiently  assessing  a situation  is  to  utilize  only 
a subset  of  the  total  information  display  which  is  manageable,  and  yet, 
approaches  some  optimal  level  of  informativeness.  Such  a display  would  vary 
in  form  o-  lal  to  trial.  That  is,  the  amount  of  information  necessary  for 
an  optimal  «.ecision  night  change  across  trials,  but  more  importantly,  the 
type  of  specific  information  needed  might  change  over  trials  due  to  the 
conditional  and  interdependent  nature  of  information.  If,  when  placed  under 
a time  constraint,  a cn— nder  engages  In  strategic  Information  processing 
in  order  to  assess  a situation,  the  results  should  be  detectable  as  condi- 
tional information  hierarchies.  The  purpose  of  this  study  was  to  attempt  to 
expose  such  hierarchies  which  subjects  might  form  when  exposed  to  time 
constrained  information  search  requirements.  Subjects  were  to  select  an 
operating  mode  and  target  choice  which  was  appropriate  to  the  information 
present  on  that  trial.  In  order  to  maxe  these  choices,  it  was  necessary  for 
the  subject  to  request  the  information  sequentially.  The  task  was  struc- 
tured such  that  it  was  not  possible  to  access  all  available  information 
before  the  end  of  a trial.  Thus,  the  subjects  had  to  search  for  an  optimr.l 
informational  configuration  on  each  trial  by  building  the  display  element  by 
element.  We  expected  chat  this  requirement  would  result  in  differential 
display  construction.  This  is  because  the  nature  of  the  situation  process 
requires  a display  which  possesses  enough  information  for  an  optimal  choice 
among  alternatives,  while  at  the  same  time  keeping  the  amount  of  information 
within  manageable  limits.  These  two  conditions  are  satisfied  only  when  the 
display  conforms  to  certain  configurations  defined  by  the  interrelationships 
of  the  Information  present  on  that  given  trial,  because  of  this,  receipt  of 
each  new  piece  of  Information  should  influence  requests  for  subsequent 
Information  such  that  a pattern  of  informational  interrelationships  should 
emerge. 

Information  was  displayed  on  a Vector  General  CRT  and  consisted  of  four 
categories;  trajectory  of  the  target  (flyby,  zigzag.  Jink),  and  presence  or 
absence  of  ECM,  OCM,  and  ARM.  In  order  to  obtain  specific  information. 
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subjects  hMd  to  activaco  a sarias  ot  catagory  raquaac  buctona.  Inforaaclon 
raquaaca  could  occur  only  at  5*sacoi&d  Intarvais.  Spaciflc  laforaatlon 
racalvad  follofwl^&s  aach  raquaac  was  randomly  datarmlnad. 

On  half  tha  triala » oua  cargat  vaa  prasanc  and  on  tha  ochar  half,  cuo  car- 
gata  vara  prasanc.  On  doubla  cargat  trlal3«  appaaranca  of  tha  sacond  cargat 
foUovad  tha  first  at  an  intarval  of  batvaan  2 saconds  and  14  saconds. 

Whanarar  a sacond  cargat  appaarad*  tha  potantial  laforaacion  sac  doublad  In 
slza. 

Tha  raaults  of  aach  trial  vara  rapraaantad  according  to  a daclsion  crta 
foraac  (Figura  3).  Analysis  Indicatad  that  optimal  display  construction  did 
Indaad  foUov  a pattam  which  rasultad  in  displays  charactarirad  by  con^* 
ditional  intarlm  dapandanca.  That  is,  tha  ordinal  ralatlonshlps  batvaan 
catagory  raquascs  vara  conditional  upon  cha  spaciflc  infomation  racalvad  at 
aach  raquast.  This  supports  tha  Idas  chat  sicuacion  asaassaant  Is  a procass 
charactarizad  by  saarch  stratagias  rasulcing  in  displays  which  allow  opciaal 
stata  astimation  and  subsaquant  procadura  salaction.  Furthar  analysis, 
although  still  in  prograsa,  has  rasultad  In  as tlaacion  of  conditional 
probabilitias  of  catagory  raquast  which  supports  thasa  qualicaciva  obsarvationa. 

EZFniKEsrr  ii 

Tha  poxpoaa  of  cha  sacond  axparlatat  vaa  to  t*^**^^  cha  affacts  of  probabllia^ 
tic  and  Incoaplata  inforaacion  of  tha  subjacts'  ability  to  optiaira  systaa 
parfomaiica*  Tha  laval  of  systsm  parfonaaca  vaa  dacazmlnad  by  tha  subjacts 
ability  to  laam  cha  ralationahips  that  axiatad  batvaan  cha  givan  Infocaa- 
tion  and  hia/har  subaaquaoc  control  baharlors*  Thaaa  cua-cricarlon  rala* 
tionahipa  wars  ravaalad  by  a faadback  matrlc  which  indicatad  a Mwntary 
aaaaura  of  cha  laval  of  parfoaanca,  thua  aliasing  vlchia-trial  control 
nodificationa  vhich.  If  corract,  could  rasult  In  parfonianca  iBprovaawnt. 

Tha  aatrlc  itaalf  conaiatad  of  a aaasura  of  tha  probability  of  kill  (P|^) 
baaad  on  cha  ranga  of  actiona  chat  tha  conandar  float  taka  during  tha  coursa 
of  an  angagaflant.  Thasa  includa  salaction  of  oparacing  nods,  firing  ranga, 
and  burst  duration. 

On  aach  trial  subjacts  racalvad  probabilistic  Infonsation  regarding  tha 
praaanca  of  councarflaasuras  (Ed,  OQt,  ARM),  aa  wall  as  idantificacion  of 
tha  cargat 'a  trajaccory,  and  target  position  Infocflation.  Countaraaaaura 
probability  inforaacion  ranged  frofl  0 to  1.00  and  vaa  normally  distrlbucad 
a • .50;  SD  • ^ .20).  At  sofla  pradacarminad  ranga  tha  probabilitias 
changed  to  aithar  0 or  1.00  to  li^caca  absanca  or  praaanca  of  cha  counter- 
maaaura.  Tha  trajectory  of  tha  target  was  mada  available  at  a ranga  of 
7.5  km  and  was  aithar  a flyby,  slgzag,  or  jixik.  Targat  position  Information 
includad  ranga,  asla^th,  and  altituda  and  vaa  availabla  in  proportions  of 
aithar  .33,  .66,  or  1,00.  On  aach  trial  tha  subjacts  task  was  to  salact  an 
operating  moda,  a burst  duration,  and  a firing  ranga.  Uhan  firing  vaa 
Iniclacad,  burst  duration  and  a l-sacood  forcad  daisy  batvaan  bursts  ware 
coflpucar  controlled.  During  firing,  subjacts  racalvad  an  Inatancanaoua  P|^ 
score  which  vaa  updacad  aach  sacond.  Tha  score  vaa  based  on  tha  charac- 
tarlscica  of  cha  target,  cha  burst  duration,  moda  chosa,  and  ranga  at  aach 
sacond  of  fira.  At  any  tima  during  firing,  subjacts  could  stop  flra  and 
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execute  any  series  of  actions;  changes  In  mode>  firing  rate,  etc.  At  the 
end  of  each  trial,  a cumulative  p based  on  Intrat^ial  performance  was 
displayed. 

The  analysis  of  this  data  was  based  on  the  following  assumption.  When 
presented  with  auboptimal  displays  subjects  possess  the  capability  of 
learning  the  relationships  between  these  displays  and  the  control  actions 
which  will  result  in  optimal  system  performance.  This  deductive  capability 
would  be  realized  as  an  ability  on  the  part  of  the  subject  to  discriminate 
among  the  alternatives  available  to  him/her.  Such  discriminative  ability 
should  be  sensitive  to  statistical  analysis.  Accordingly,  two  discriminants 
analyses  were  performed  using  the  display  elements  as  predictors  end  mode 
choice  as  the  variable  to  be  discriminated. 

RESULTS 

The  first  analysis  considered  only  the  presence  or  absence  of  target  posi- 
tion Information,  in  addition  to  trajectory  and  countermeasure  probabili- 
ties. A step%rlse  analysis  was  performed  using  the  minimum  D squared  selec- 
tion criteria.  Seven  of  the  eight  variables  entered  the  equation;  the  only 
variable  not  contributing  significantly  to  discriminative  power  was  altitude 
Information.  The  two  discriminant  functions  resulting  from  this  analysis 
accounted  for  all  of  the  mode  selection  variability,  with  the  first  function 
explaining  94.09  percent  of  this  variability.  Both  the  final  weights 
attached  to  each  prediction,  and  the  order  in  which  variables  were  entered 
Into  the  equation,  support  the  Idea  that  subjects  were  engaging  in  a selec- 
tive information  evaluation  process,  the  Intent  of  which  was  to  evaluate  the 
utility  of  each  available  alternative,  eliminate  those  which  vere  Inappro- 
priate, and  select  the  one  which  would  yield  the  highest  expected  performance. 

The  final  function,  with  seven  of  the  eight  variables  considered,  revealed 
that  trajectory  name  was  the  most  heavily  weighted  variable,  followed  in 
order,  by  the  probabilities  of  ECM,  ARM,  and  OCK.  The  presence  or  absence  of 
target  position  Information  resulted  In  low,  although  still  significant, 
weightings.  These  weights  Indicate  that  subjects  were  comparing  the  alter- 
natives against  one  another  primarily  on  the  basis  of  that  Information  which 
would  allow  the  most  rapid  discrimination  among,  and  elimination  of,  modes 
In  terms  of  their  defining  characteristics. 

This  Interpretation  Is  supported  by  the  order  cf  entry.  At  the  initial  step 
of  the  analysis,  the  variable  providing  the  most  discriminating  power  was 
the  probability  of  OCM.  This  seems  to  Indicate  the  subjects  were  Initially 
evaluating  the  alternative  set  on  the  basis  of  the  utility  of  radar  capa- 
bility under  the  conditions  present,  thus  allowing  an  initial  crude  evalua- 
tion of  mode  utilities  in  terms  of  the  most  salient  separating  feature  of 
the  mode  set.  Step  2 of  the  analysis  (probability  of  ECM  entered).  Implies 
that  the  subject  Is  attempting  to  furth^**  discriminate  among  radar  vs. 
nonradar  utilities.  The  entry  of  trajec  ^ry  name  on  the  third  step,  and 
probability  of  ARM  on  the  fourth  step,  confirms  this  Idea.  At  this  point, 
the  subject  is  now  able  to  discriminate  maximally  between  all  three  mode 
alternatives  In  terms  of  the  usefulness  of  eacii.  Further  entrance  of  pre- 
dictors Into  the  equation  results  In  little  Increase  in  discriminative  power. 
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A classification  tabls  Indicated  that  a total  of  79.25  percent  of  the  cases 
were  placed  Into  the  appropriate  group  oMabershlp  categOi.7  by  the  dlscrlni* 
nant  functions.  The  major  source  of  error  In  the  overall  clMSlflcatlon  was 
due  to  a complete  Inability  to  correctly  classify  mode  2 selections  Into  the 
appropriate  group*  Only  2.1  percent  of  such  cases  vere  correctly  else* 
slfled.  This  Is  compared  to  correct  classifications  for  modes  1 and  3 of 
61.8  percent  and  90.5  percent,  respectively. 

The  second  analysis  considered  those  trials  on  which  the  actual  values  of 
t44e  position  Information  was  available.  The  outcome  of  this  analysis  took 
a somewhat  different  form  than  did  the  first  analysis*  With  regard  to 
variable  weightings,  two  types  of  position  Information,  al^ng  with  trajec- 
tory name,  assumed  the  most  Importance.  These  two  vere  azimuth  and  altitude 
Information.  The  order  of  entry  was  also  different  from  the  first  analysis. 
Azimuth  Information  was  the  first  to  unter  the  analysis.  This  Is  not 
surprising,  since  the  presence  of  this  value  allows  subjects  to  accurately 
Infer  the  trajectory  of  the  target,  as  well  as  obtaining  azimuth  Informa- 
tion. Given  this  knowledge,  the  next  three  most  Important  types  of  Infor- 
mation were  the  probabilities  of  ECM,  ABM,  and  OCM,  respectively.  Again, 
this  Is  In  line  with  the  Idea  that  si^jects  vere  attempting  to  eliminate 
alternatives,  and  thus  uncertainty  on  the  basis  of  defining  characteristics 
of  the  modes.  Thus,  on  those  trials  when  EQf  probability  was  low,  the  next 
most  Important  consideration  was  the  probablliy  of  ARM.  Once  this  proba- 
bility had  been  evaluated,  OCM  probability,  by  virtue  of  Its  Influence  on 
mode  6 usefulness,  was  evaluated*  Inspection  of  the  level  of  dlscrlmina- 
blllty  revealed  that,  beyond  this  point,  the  entry  of  other  predictors 
cor.crlbuted  very  little  discriminative  power. 

The  classification  table  for  this  analysis  revealed  a successful  group 
membership  prediction  of  83*47  percent.  Again,  the  major  source  of  classi- 
fication error  was  the  Inability  to  correctly  predict  mode  2 membership.  Of 
the  mode  2 selections,  4.30  percent  vere  Incorrectly  classified  as  belonging 
In  the  mode  1 group,  and  95.70  percent  vere  Incorrectly  placed  In  the  mode  6 
group.  Seventy-six  percent  of  the  mode  1 selections  vere  correctly  classi- 
fied In  this  analysis,  and  90.90  percent  of  the  mode  6 choices  vere  placed 
correctly. 

Finally,  ve  feel  that  some  comments  are  warranted  concerning  one  of  the  most 
striking  aspects  of  this  experiment,  that  Is,  the  complete  Inability  to 
accurately  predict  mode  2 selections  on  the  basis  of  the  Information  avail- 
able to  the  subject.  Some  reflection  on  the  properties  and  capabilities  of 
the  three  modes  Indicates  that,  perhaps,  this  result  should  not  have  been 
totally  unexpected.  Activation  of  mode  2 requires  that  the  subject  utilize 
aspects  ,nat  are  Indigenous  to  both  modes  1 (radar  range  Information)  and  6 
(manual  az  and  el  estimation).  Thus,  mode  2 can  be  thought  of  a falling 
along  a continuum  between  podes  1 and  6.  Since  the  Information  that  is 
being  weighted  most  heavljy  by  the  subject  has  the  greatest  effect  on  either 
mode  1 (trajectory,  EQi,  ABM)  or  mode  6 (trajectory,  OCM),  and  since  the 
strategy  of  the  subjects  seems  to  be  based  on  rapid,  and  somewhat  noncompen- 
satory, elimination  of  alternatives,  mode  2 Is  often  eliminated  from  con- 
sideration along  with  elimination  of  the  mode  whose  defining  characteristics 
are  being  matched  against  target  attributes  at  that  step  In  the  decision 
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process.  This  leads  to  the  result  that»  in  the  few  cases  in  which  node  2 
is  selected » it  is  almost  impossible  to  classify  correctly  because  the 
variables  used  for  classification  are  not  considered  to  apply  primarily  to 
mode  2.  In  short » it  appears  that  conceptually  mode  2 has  no  unique  defining 
characteristics • 


CONCLUSIONS 

Preliminary  analyses  of  these  data  indicate  that  the  following  conclusions 
are  ncssible. 

1,  In  order  to  assess  a situation  optimally » subjects  will  engage  in 
strategic  information  search  designed  to  extract  maximum  usefulness 
from  a display » which  limits  that  display  to  a size  that  is  within 
human  processing  lixltations.  This  will  result  in  a limited  number  of 
display  structures  characterized  by  hierarchies  which  are  defined  by 
rhe  Interdependencies  of  the  Information  set. 

2.  Subject's  control  decisions  are  based  upon  an  ability  to  Infer  the 
relationship  between  information  displays  possessing  scooptlnal  valid- 
ity and  a subsequent  outcome.  This  capability  manifests  ItseJf  as  an 
ability  to  discriminate » from  among  a set  of  alternatives,  that  alter- 
native which  will  maximize  the  cue-criterion  relationship,  as  indexed 
by  outcome  feedback. 

Subsequent  work  In  our  laboratories  related  to  these  two  experiments  will 
focus  on  the  structuring  of  the  various  Information  search  and  processing 
strategies  employed  by  the  comiander  and  on  the  factors  which  influence  the 
activation  and  use  of  these  various  strategies.  Additionally,  we  plan  to 
Investigate  variables  effecting  the  cognitive  activicy  Involved  In  the 
conmander's  utilization  of  the  relationship  between  external  condltlcr;;  aud 
his  knowledge  and  creative  use  of  system  capabilities. 
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ABSTRACT 

Control  of  a slowly  responding  coaplex  dynaaic  systea  such  as  a large 
supertanker  poses  special  probieas  for  the  huaan.  Forming  an  internal  aodel 
of  such  a systea  is  more  difficult  than  that  of  systeas  whose  response  charac* 
teristics  aatch  those  of  the  huaans  more  closely.  For  instance,  due  to  slow 
response,  quick  control  actions  such  as  those  required  in  flying  an  aircraft 
are  not  needed.  Instead  control  actions  aust  be  based  on  inforaation  over  a 
longer  tiae  span.  The  aodel  should  have  appropriate  features  to  handle  such 
situations.  It  is  not  clear  as  to  what  types  of  display  aids  aight  be  helpful 
in  foraing  the  internal  model  and/or  for  better  control.  Experiments  were 
conducted  to  study  this  problem.  Experienced  ship's  crew  members  maneuvered  a 
simulated  ship  in  real  tiae.  The  simulation  was  performed  using  a graphics 
display  run  by  a PDP  11/40  ainicomputer.  The  maneuvers  consisted  of  piloting 
a large  ship  along  a narrow  waterway.  Prel'minary  results  suggest  that  the 
human  operMes  as  a feedforward  controller  utilizing  the  preview  inforaation 
for  'gross  changes'  in  heading,  and  as  a feet'.back  controller  for  correcting 
small  deviations.  The  instruments  displayed  on  the  deck  do  not  seen  to  be 
helpful  in  all  situations.  In  fact,  eviderce  seems  to  indicate  that  some  of 
the  displays  aight  even  interfere  with  the  pilot's  attempt  to  fora  a good 
internal  model. 


INTRODUCTION  AND  MOTIVATION 

Traditionally,  in  ship  simulators  and  in  crew  training  the  basic  operat* 
ing  hypothesis  has  been  based  on  task  behavior  training.  The  crew  were  trained 
in  operations  wnere  they  could  respond  to  a set  of  stimuli  in  a pre-determined 
fashion.  This  had  its  origins,  perhaps,  in  airplane  simulators,  and  other 
operations  where  enough  tiae  was  usually  not  available  for  detailed  analysis 
of  the  state  of  the  system.  When  sufficient  tiae  is  not  available  for  thinking 
through  * problem  it  becomes  necessary  to  use  strategies  whereby  conditioned 
responses  substitute  for  fast  and  timely  actions. 

Such  a situation  does  not  prevail  in  the  operation  of  a ship  due  to  the 
slow  changes  in  speed  and  heading.  If  the  crew  has  sufficient  training  it  is 
possible  to  have  a good  internal  aodel  of  the  ship  and  be  able  to  control  it 
based  on  the  actual  state.  In  fact,  in  aircraft  operations  t is  well  known 
that  the  pilot  operates  as  if  he  has  a good  internal  aodel.  Usually,  the  hu- 
aan operator  uses  inforaation  provided  by  the  systea  as  feedback  to  correct 
for  errors  and,  generally  for  improving  the  performance. 

However,  in  slow  systeas  such  as  piloting  a ship,  feedback  may  not  al- 
ways be  helpful.  Feedback  could  prevent  the  forest  ion  of  the  internal  aodel 
initic  Uy, 
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and/or  interfere  with  the  operation  of  the  internal  aodel  later.  When  the 
operator  has  an  insufficient  aodel  o.  the  systea  under  control,  it  is  possible 
that  he  fails  to  analyze  the  situation  carefully  and  acts  iapulsively  based  on 
the  feedback  inforaation.  Under  these  conditions,  it  aay  be  advantageous  to 
reaove  soae  (or  aost)  of  th»  feedback  displays  so  that  he  is  forced  to  think 
through  the  situation  and  act  accordingly.  Even  in  cases  where  feedback  is 
helpful,  proper  fora  of  feedback  is  essential.  Relevance  of  various  instru* 
aents,  and  quant i t ir  . to  be  aeasured  and  displayed  aust  be  carefully  chosen. 
Understanding  what  t sponents  are  iapo  ..ant,  what  the  input/output  relation- 
ships are  etc  are  iaportant.  Experiaents  were  conducted  to  study  various  fac- 
tors discussed  above,  odeling  efforts  are  being  aade  to  understand  better  the 
various  quantities  involved,  and  how  they  affect  perforaance. 

Depending  upon  the  faailiarity  of  the  huun  with  the  systca  under  con- 
trol one  or  aore  of  the  following  aodes  of  inforaation  aay  be  used  by  the  hu- 
aan.  The  operation  could  be  open  loop  or  closed  loop,  or  soae  fora  of  feed- 
back and/or  feedforward  inforaation  could  be  used.  Instruaents  aay  reflect 
coaaanded  quantities  and  response  quantities.  These  .-re  soae  of  the  issues  to 
be  considered  in  the  experiaents  and  in  aodeling. 

experihent 

Dynaaics  of  a large  supertanker  of  250,000  dwt  was  siaulated  on  a PDF 
11/40  coaputer  with  the  VT11  Graphics  systea.  A aock  up  of  the  ship*s  console 
was  used  to  control  the  dynaaics  of  the  ship.  The  console  had  a ship's  wheel 
and  throttle  control.  The  equations  of  aotion  were  taken  froa  Coastock^. 

The  display  generated  by  the  coaputer  is  shown  in  Figure  1,  and  is  siai- 
lar  to  the  view  froa  the  bridge  of  a large  supertanker.  The  ship's  bow 
reaained  fixed  and  the  background  aoved  past  the  ship.  A three  diaensional 
view  was  presented  corresponding  to  the  observer's  height  of  80  feet.  The  in- 
struaents available  for  display  were:  coapass,  rate  of  turn  indicator,  tachoa- 
eter,  rudder  angle  indicator,  speed  indicator,  and  tiae  display.  Any  coabina- 
tion  of  the  displays  could  be  included  in  any  particular  experiaent. 
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Th«  Mneuvering  area  of  the  ship  was  based  on  the  Savannah  River,  vith 
soae  aodifications  to  accoaodate  a supertanker,  and  to  take  into  account  the 
liaited  capabilities  of  the  coaputer.  The  essential  details  were  included  how* 
ever,  and  the  scenario  provided  opportunites  for  a nuaber  of  different 
aaneuvers  within  a 2 1/2  hour  tiae  period. 

The  subjects  were  instructed  about  the  operation  of  the  ship,  and  were 
shown  the  lay  out  of  the  buoys  that  define  the  course.  During  the  experiaent, 
they  had  access  to  a chart  of  the  course.  The  basic  aaneuvers  to  be  perforaed 
by  the  subjects  were: 

1.  Accelerate  and  enter  the  aain  buoyed  channel  froa  a stopped  position. 

2.  Turn  in  the  channel  at  various  angles  and  speeds. 

3.  Enter  a buoyed  channel,  decelerate  and  reaain  at  a slower  speed. 

4.  Maintain  a set  heading  of  the  vessel. 

The  experiaent  consisted  of  four  phases.  In  the  first  phase,  all  the 
displays  were  available.  The  passage  was  up  the  river.  The  subjects  were  in* 
structed  in  the  proper  use  of  the  controls  to  obtain  desired  response.  Soae 
of  the  iaportant  characteristics  were  explained.  In  particular,  the  subjects 
were  instructed  as  follows: 

1.  A streaa  of  water  over  the  rudder  is  needed  to  produce  a radial  accelera* 
tion.  This  could  be  achieved  either  by  a forward  velocity  of  the  ship  or 
by  an  increase  in  propeller  RPM*  For  a given  forward  velocity,  an  in* 
crease  in  RPM  would  increase  the  velocity  of  the  streaa  of  water  over  the 
propeller. 

2.  Control  of  the  ship  could  be  achieved  by  acceleration.  Rate  of  Turn 
(ROT)  and  speed  reflect  i any  changes  in  control. 

In  addition,  aaxioiua  rudder  rate  and  RPM  acceleration  were  pointed  out  to  the 
subjects  (3  deg/sec  and  2 RPM/sec  respectively.)  The  subjects  were  also  aware 
of  a slight  instability  in  the  ship*s  dynaaics. 

In  the  second  phase,  the  sik)jects  were  allowed  two  instruaents  of  their 
choice.  The  reaaining  instruaents  wer>  not  available.  As  in  the  first  phase, 
the  passage  was  up  the  river.  The  subjects  were  trained  in  such  a way  that 
aost  of  the  instruaents  becaae  unavailable  for  feedback.  At  the  end  of  this 
phase,  usually  lasting  a single  run,  the  subjects  had  enough  training  to  be 
able  to  aaneuver  the  ship  without  any  instruaent . 

No  instruaents  were  available  for  the  third  phase.  Hence,  it  was  not 
possible  to  apply  soae  input  and  watch  the  effect  on  the  instrvrift  nt  display. 
The  only  feedback  was  by  observing  the  view  froa  the  bridge  after  any  control 
input.  Due  to  the  inherent  slowiiess  of  the  dynaaics  of  the  ship,  the  controls 
had  to  be  carefully  chosen,  based  on  analysis  of  the  situation.  Since  30*40 
seconds  would  have  elapsed  before  the  results  of  soae  response  would  be  evi* 
dent  in  the  view  froa  the  bridge,  iaaediate  feedback  would  be  all  but  iapossi* 
bit. 


In  the  fourth  phase,  instruaents  were  not  available,  and  the  passege  was 
down  the  river.  This  forced  the  subjects  to  approach  the  turns  at  different 
speeds  v ling  different  plans  for  the  aaneuvers.  Therefore  the  course  seeaed 
quite  diffe'*ent  to  the  subjects.  This  phase  was  used  as  the  final  testing  of 
the  subjects*  control  beha^Mor. 
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Durirkg  the  txperiaent^  inforMtion  conctming  inputs  (rudder  angle  and 
throttle  (RP90  requests),  and  the  position  of  the  ship  (coordinates)  uas  col* 
lected.  The  data  were  collected  for  all  phases  except  for  the  second  phase 
when  the  subjects  were  trained  to  pilot  the  ship  without  the  use  of  feedback 
displays  (instruaents).  At  the  end  of  every  Maneuver,  the  subjects  were  also 
asked  to  fill  out  a questionaire  concerning  the  efforts  in  perforaing  that 
Maneuver. 

Since  the  lateral  control  was  achieved  by  changes  in  radial  accelera* 
tion,  produced  either  by  using  the  rudder  angle  or  by  changing  the  RPfl  of  the 
propeller  (or  a coabination  of  both),  the  control  input  of  the  subject  was 
converted  into  an  equivalent  rudder  input.  For  a given  coabination  of  rudder 
and  throttle  inputs,  the  equivalent  rudder  input  was  calculated  as  that  input 
that  would  produce  the  saae  rate  of  turn  if  rudder  alone  were  to  be  applied. 
This  is  based  on  the  assuaption  that  the  subject  used  a coabination  of  con* 
trols  to  get  soae  desired  radial  acceleration.  It  is  presuaed  that  the  input 
applied  was  chosen  aainly  to  get  the  desired  radial  acceleration. 

THE  SUBJECTS 

Four  subjects  participated  in  the  experiaent,  involving  aore  than  fifty 
hours  of  siaulated  operation.  In  teras  of  US  Coast  Guard  Licenses,  two 
(6SA,RPH)  were  **Third  Rates  of  Steaa  Vesssels  of  Any  Tonnage,  Upon  Oceans**.  In 
addition,  they  were  licensed  **Third  Assistant  E^ineers  of  Steaa  and  Rotor 
Vessels  of  any  Horse  Power**.  One  of  thea  (RPH)  also  had  the  classification  of 
**Chief  Engineer  of  Uninspected  Towing  Vessels  of  Any  Horsepower,  Upon  Rivers.** 
The  third  subject  (FE6)  was  **Chief  Rate  of  Steaa  Vessels  of  Any  Tonnage,  Upon 
Oceans.'*  The  aost  experienced  subject  (DAH)  is  "Raster  of  Steaa  Vessels  of  Any 
Tonnage,  Upon  Oceans.*'  Since  all  of  thea  had  a lot  of  experience  in  real 
ships,  their  transition  to  the  siaulator  was  saooth  and  fast. 

POSSIBLE  RODES  OF  CONTROL 

The  Main  control  characteristics  of  interest  concern  • lateral  aotion 
of  the  ship  along  the  channel.  At  various  points  in  the  course  of  the 
aaneuver,  the  ship  had  to  aake  turns  at  va  ious  angles  and  at  various  speeds. 
It  is  our  desire  to  be  able  to  aodel  the  control  behavior  in  terns  of  soae 
analytical  aethods.  Possible  aodes  of  control  are:  open  loop  control  without 
waking  use  of  any  fora  of  feedback  (utilizing  only  the  feedforward  inforaation 
about  the  desired  course),  closed  loop  control  with  feedback  froa  instantane* 
ous  feedback  froa  the  instruaents  on  the  bridge,  closed  loop  control  based 
solely  on  the  inforaation  obtained  froa  observations  on  the  deck,  and  a coabi* 
nation  of  various  feedback  and  feedforward  controls.  It  is  also  possible  that 
the  controller  is  capable  of  separating  the  controls  into  one  or  aore  regions, 
and  identifying  proper  course  of  action.  Appropriate  controls  can  then  be  ap* 
plied  to  get  the  desired  perforaance. 

In  a purely  open  loop  systea,  for  changes  in  heading,  the  control  action 
would  be  based  on  the  difference  between  the  feedforward  inforaation  and  soae 
fixed  reference.  The  resulting  control  would  consist  of  a single  pulse  or  a 
step  of  finite  duration  to  initiate  a turn,  and  a siailar  action  in  the  oppo- 
site direction  to  bring  the  ROT  back  to  zero.  Unless  the  control  systea  is 
calibrated  to  coapensate  for  any  directional  instabilities,  no  additional  con* 
trol  actions  will  be  involved  in  the  operation  of  such  a systea. 
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On  the  other  hand,  in  a closed  loop  «yste«,  the  control  actions  nould  be 
based  on  the  error  between  the  desired  headinp  and  the  actual  heading.  Since 
there  would  be  soae  error  until  the  desired  heading  is  reached,  continuous 
control  will  result.  In  practice,  this  would  aanifest  itself  as  a nuaber  of 
pulses  closely  spaced  together.  Control  would  be  zero  only  when  the  error  be* 
cones  zero. 

It  is  also  possible  that  the  subject  Merely  functions  as  an  open  loop 
(feedforward)  controller  as  long  as  the  error  reaains  within  soae  tolerance 
Unit.  When  this  liait  is  exceeded,  action  is  taken  to  reduce  the  deviation 
and  li^it  the  drift.  Depending  upon  the  tolerance  the  subject  has  for  the  er* 
ror  or  deviation  there  could  be  additional  control  pulses  along  the  course  of 
the  turn.  This  situation  would  result  in  a control  behavior  having  a nuaber  of 
pulses  at  various  points  in  tiae.  This  would  be  soaewhere  between  the  coa* 
pletely  open  loop  and  coapletely  closed  loop  systeas. 

EXPERIHENTAL  RESULTS 

The  discussions  of  the  previous  section  are  aeant  to  provide  a fraaework 
for  analyzing  the  results  of  the  experiaent.  In  this  section,  results  for  all 
four  of  the  subjects  are  discussed*  (Detailed  results  are  given  in  Amott^.) 
Each  subject  will  be  considered  separately  in  an  effort  to  understand  the  pos- 
sible aode(s)  of  operation. 

Froa  the  results  for  subject  FEE,  it  appears  that  he  behaved  as  a 
feedforward-feedback  controller  aost  of  the  tiae.  Though  only  feedforward  con- 
trol is  used  initially  (open  loop),  apparently  error  builds  up  rapidly,  and 
there  appears  to  be  a need  :o  coapensate  for  the  error  by  using  proper  aaount 
of  control  alaost  continuously.  Equivalent  control  inputs  increase  after  an 
initial  open  loop-like  behavior.  He  could  control  the  ship  without  using  any 
of  the  instruaent  displays,  though  the  control  effort  appeared  to  be  auch  aore 
than  that  required  when  feedback  froa  the  instruaents  were  available.  But  ac- 
cording to  the  response  froa  to  the  questioneire,  his  stress  level  was  lower 
when  there  were  no  instruaents.  Apparently  this  indicates  that  his  visual 
workload  was  reduced  when  instruaent  displays  were  reaoved.  The  perfcraance  in 
holding  a steady  course  did  not  suffer  when  the  displays  were  absent.  Reaovai 
of  the  feedback  displays  did  not  seea  to  affect  his  perforaance  in  any  of  the 
phases. 


In  turns,  DAH  seeaed  to  perfora  as  a feedforward-feedback  device.  Howev- 
er, in  soae  turns  his  controls  were  alaost  continuous,  siailar  to  that  of  a 
closed  loop  controller.  His  ability  to  hold  a steady  course  without  the  in- 
struaents was  not  as  good  as  having  thea  to  aid  in  control.  Apparently  it  was 
difficult  to  get  sufficient  inforaation  about  the  course  of  the  ship  without 
the  aid  of  displays.  In  fact,  the  inforaation  in  the  questicnaire  suggests 
that  he  aight  be  trying  to  obtain  the  inforaation  froa  the  display  of  the  en- 
vironaent.  The  response  to  the  questionaire  suggests  that  he  could  be  using 
the  inforaation  aore  efficiently  by  analyzing  the  situation  aore  carefully  and 
using  the  internal  aodel  aore  effectively. 

There  was  a tendency  for  6SA  to  act  as  a closed  loop  controller  when  in- 
struaent displays  were  available  for  feedback,  and  also  when  he  transitioned 
.nto  a node  with  feedback  displays  reaoved.  Apparently  he  could  not  develop  a 
sufficiently  accurate  internal  aodel  and  had  to  rely  on  feedback  inforaation 
either 
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froa  the  instruacnts  or  from  the  vieti  from  the  bridge.  experience  In- 
creased, he  started  to  act  eore  like  an  oren  loop  controller  or  a combination 
of  fee<tt>ack- feedforward  controller.  From  tne  questionaire  and  from  the  data  on 
control  and  track,  it  appears  that  the  feedback  displays  interfered  with  the 
formation  of  a good  internal  model.  He  devoted  so  much  time  to  the  informatfon 
dislayed  on  the  instruments  that  he  coutd  not  think  about  the  consequences  of 
any  action. 

When  the  displays  provided  the  feedback,  the  subject  RPH  was  controlling 
more  like  an  open  loop  controller*  Later,  with  more  experience^  he  started  to 
act  more  like  a feedforward-feedback  controller.  His  oerformance  did  not 
suffer  appreciably  when  feedback  information  provided  by  the  instruments  was 
absent. 


DISCUSSION  AND  POSSIBLE  APPROACHES  TO  N0DELIN6 

Though  the  experiments  were  rather  detailed,  the  results  are  prelim- 
inary. These  results  seen  to  suggest  that  a combination  of  feedforward  and 
feedback  information  is  used  by  the  subjects  to  control  the  ship  in  lateral 
motion.  From  the  results  obtained  when  the  instruments  were  available  it  ap- 
pears that  they  were  not  always  helpful  for  control.  In  fac^,  during  some 
phases  they  might  have  been  a hindrance  because  of  the  misleading  information 
about  control  **esulting  from  the  responses  of  the  instruments  themselves.  They 
light  also  have  increased  the  subject*s  workload. 

When  information  concerning  the  future  trajectory  is  available  for  some 
time  it  has  been  found  what  the  human  uses  a combination  of  feedback  and  feed- 
forward controls.  In  particular,  the  work  of  Donjes^  on  modeling  the  car 
driver  seems  relevant.  He  found  that  gross  changes  in  direction  were  con- 
trolled as  if  the  control  was  open  loop  and  minor  deviations  from  the  desired 
trajectory  were  then  corrected  in  a closed  loop  fashion.  In  a preview  control 
task,  Govindaraj  and  Rouse^  obtained  similar  results.  It  was  found  that  some 
form  of  feedforward  and  feedback  information  was  used  for  control.  It  was  also 
found  that  control  was  applied  only  when  the  perceived  error  exceeded  a cer- 
tain tolerance  level.  Control  was  therefore  intermittent.  This  type  of  control 
behavior  was  characteristic  of  many  of  the  subject  uns  in  our  experiment. 

Modeling  efforts  are  underway  to  study  this  type  of  control.  In  particu- 
lar, it  will  be  interesting  to  find  out  if  there  are  thresholds  for  errors 
and/or  controls.  This  might  give  an  indication  of  the  relative  amounts  of 
feedback  and  feedforward  information.  Detailed  experiments  will  then  be  con- 
ducted to  verify  the  modeling  results.  The  model  migi  t also  be  helpful  in 
understanding  which  of  the  feedback  displays  are  more  useful  and  which  might 
even  be  harmful  in  the  development  of  good  control  habits. 

It  is  possible  that  there  is  a hierarchical  control  approach  that  the 
pilot  uses  in  cont^  1.  Depending  upon  the  relative  importance  of  various  er- 
rors (or  some  other  information)  control  might  take  different  forms.  Different 
levels  in  the  model  might  be  able  to  take  care  of  appropriate  phases  in  the 
information.  Delegation  of  authority  for  cont**ol  to  different  levels  might  be 
done  by  some  simple  device  such  as  a comoination  low  pass-high  pass  filter  or 
some  other  complex  mechanism.  These  and  other  possible  methods  will  be  ex- 
plored in  greater  detail.  Plodels  developed  will  he  validated  by  running  de- 
tailed experiments. 
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ABSTRACT 

Effects  of  task  variables  on  the  perf’^roance  of  the  human  supervisor 
by  means  of  modelling  techniques  are  uiscussed.  The  task  variables 
considered  are:  The  dynamics  of  the  system, the  task  to  be  performed * 
the  environmental  disturbances  and  the  observation  noise. 

A relationship  between  task  variables  and  parameters  of  a supervisory 
model  is  assumed.  The  model,  reported  by  Kok  and  Van  tfijk  consists 
of  three  parts:  (1)  The  observer  part  is  thought  to  be  a full  order 
optimal  observer,  (2)  the  decision-making  part  is  stated  as  a ser 
of  decision  rules,  and  (3)  the  controller  part  is  given  by  a control 
lav. 

The  observer  part  generates,  on  the  basis  of  the  system  output  and 
the « control  actions,  an  estimate  of  the  state  of  the  system  and  its 
associated  variance.  The  outputs  of  the  observer  part  are  then  used 
by  the  decision-making  part  to  determine  the  instants  in  time  of  the 
observation  actions  on  the  one  hand  and  the  controls  actions  on  the 
other.  The  controller  part  makes  use  of  the  estimated  statr  co  derive 
the  amnlitude(s)  of  the  control  action(s) . 

In  addition  to  the  identification  of  the  model  parameters,  b^  a random 
search  method,  a more  psychologically  oriented  method  is  used,  primarily 
based  on  statistics.  The  psychological  approach  deals  with  a direct 
comparison  of  the  nuoiber  of  control  actions,  the  amplitudes  of  those 
control  actions,  and  the  number  of  observation  actions  generited  by  the 
operator  as  a function  of  the  task  variables  mentioned  before* 

The  system  theoretical  and  the  psychological  approach  will  be  discussed  and 
a cootparison  of  the  results.using  both  approaches, will  be  given. 


* This  research  is  sponsored  by  the  Netherlands  Organisation  for  the 
Advancement  of  Pure  Research 
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lUTRODUCnON 

Due  to  the  ever  increasing  autoaation  in  industry  the  task  of  the  human 
OMrator  has  shifted  from  direct  manual  control  to  supervisory  control* 
However,  this  task  still  can  he  considered  as  a control  task,  hut  on  a 
higher  mental  level  and  of  a discrete  character.  This  means  that  only  when 
deviations  of  the  observed  variables  beyond  the  specified  boundaries  are 
detected,  due  to  failures  and/or  disturbances  in  the  automated  systes*, 
corrective  actions  are  initiated.  The^^efore,  the  task  involves  monitoring 
the  system,  as  well  as  decision  making  and  control. 

For  the  optimal  design  of  man^nachine  interface  iWIF)  a profound 
understanding  of  the  supervisor's  behavior  is  necessary.  This  can  be 
obtained  by  modeling  the  human  operator's  behavior,  for  instance  during 
supervision  of  a system  in  a steady  state  mode*  For  this  purpose  descriptive 
models,  or  normative  models,  can  be  used. 

LTSCRIPnON  OP  A SUPERVISORY  MODEL 

In  this  paper  we  consider  the  verification  of  a normative  model  describing 
the  human  operator  control  of  slowly  responding  complex  systems. 

The  model  is  based  on  the  concepts  of  the  Optimal  Control  Model  [ Baron » 
Oeinman  1969;  P.einaan,  Baron,  Levison,l971]  and  was  proposed  by  Kok  and 
Van  Wijk  [3]. 

The  purpose  of  the  model  is  to  describe  human  behavior  in  relationship  with 
a set-point  controlled  process  in  a steady  state  mode. 

The  model  is  based  on  the  hypotheses  that  the  operator  has  knowledge  about: 
o the  system  dynamics, 

0 the  statistical  properties  of  the  disturbances  acting  on  the  system  and 
o the  task  to  be  performed. 

It  is  assumed  that  the  operator's  knowledge  is  perfect,  that  the  model  can  be 
described  by  a set  of  linear  differential  equations  and  that  the  system  is 
relatively  slow  in  comparison  to  the  neuro-muscular  system  of  the  human  being. 
The  structure  of  the  model  is  further  based  on  the  hy^theses  that  the 
operator  estimates  the  state  of  the  system  independent  of  the  control  task. 

So,  the  ^eptration  theorem  of  optimal  linear  filtering  and  control  is 
accepted  here  as  a basic  mechanism  of  the  operator's  behavior. 

The  model  then  consists  of  an  observer  part,  a controller  part  and  a 
decision  making  rmrt  (see  Fig.  l). 


Fig.  1 The  model  of  the  human  operator 
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The  observer  part  models  the  observation  behavior  of  the  supervisor. 

Based  on  the  knowledge  of  the  system  dynamics,  the  values  of  the  observed 
output  variables,  the  noise  statistics  and  the  applied  inputs  on  the  system, 
a reconstruction  or  estimate  ^(t)  of  the  process  state  and  its  associated 
variance  Vjj  is  generated  by  the  observer  part.  The  reconstruction  mechanism 
is  modeled  by  a Kalman  predictor  algorithm. 

The  controller  part  detezmines  the  amplitude  of  the  discrete  control  actions 
based  on  the  estimated  value  of  the  state. 

The  function  of  the  decision  making  part  is  twofold.  Using  the  estimated 
value  of  the  state  and  its  associated  variance,  the  decision  making  part 
determines  the  instants  in  time  that  new  observation  actions  are  to  be 
taken  aa  well  as  the  instants  in  time  that  a controller  action  should  take 
place. 

The  decision  making  part  for  the  observation  actions  (D.O.)  is  modeled 
by  a hyperbolic  decision  line,  %diereas  the  decision  making  part  for  the 
controller  actions  (D.C.)  is  modeled  as  a straight  decision  line. 

See  Fig.  2 and  3. 


WKiflointy 


Fig.  2.J  Structirre  of  the  Decision  Making  Part 

The  parameters  are;  C£  - the  curve  parameter  of  the  decision  line, 

cr.  - the  minimal  accepted  uncertainty  and  - the  upner  or  lover 
y^min 

tolerance  r .lated  to  the  nominal  output  value,  where  i denotes  the  i«^th 
outnut  variable  and  the  estimated  output  variable. 

MODEL  HYPOTHESES 


For  the  verification  of  the  oa'del  we  consider  the  so-called  task  variables 
in  relation  to  the  outputs  of  the  model. 

The  (independent)  task  variables  are:  o the  dynamic  of  the  system 

o the  noise  parameters 
o the  display  structtire  and 
o the  stxpervis^ry  task  to  be 
performed 

From  the  behavior  of  the  operator  there  are  quantities  which  can  be 
measoired  directly  such  as: 
o the  number  of  observation  actions 
o the  number  of  control  actions  and 
o the  amplitude  cf  the  control  actions 
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Since  the  quantities  meastired  are  the  observed  outputs  of  the  supervisor » 
they  should  be  related  to  the  structure  of  the  model. 

As  variations  in  the  display  structure  can  only  effect  the  human  pattern 
recognition  and  reconstruction  of  the  state,  it  is  postulated  that: 
o the  effect  of  the  task  variable  "variations  ol  the  structure  of  the 
display”  will  be  ‘fleeted  in  the  nunoer  of  observation  actions  and 
not  in  the  ntaaber  of  controller  actions. 

It  is  further  postulated  that: 

o the  effect  of  the  task  variable  "variations  of  the  intensity  of  the 
system  disturbances”  will  be  reflected  in  the  number  of  control  actions 
and  in  an  additional  mmiber  of  observation  actions. 

It  will,  however,  not  be  reflected  in  the  mean  of  amplitudes  of  the 
controller  actions . See  Table  1 . 

Table  1 

Ifumber  of  Obs.Act.  Number  of  Contr.Act.  Amplitude 

of  Contr.Act. 

Variations  of  the 
intensity  of  the 
system  disturbances 

Variations  of  the 
display  structure 


In  a later  phase  hypotbestea  with  regards  to  the  parameters  of  the  three 
different  parts  or  the  nnodel  will  be  postulated  and  verified. 

.'^ESCRIPnOI  OF  THE  PROCESS 

To  verify  the  model  hypotheses  a computer  simulation  of  a linear  slow 
responding  more  or  less  complex  system  was  develpped.  We  took  an 
example  studied  by  Camnbell  and  Shirley  from  the  Foxboro  Co^any. 
The  setpoint  cc?rtro'Lled  process  (utility  plant)  consists  of  a boiler, 
a backpressure  turbine  and  a condensing  turbine.  The  process  has  three 
inputs  (a  high  pressure  controller,  a flow  controller  of  the  low 
pressure  steam  sad  a power  controller)  and  three  outputs  (the  pressure 
of  the  high  pressurestesit:,  the  flow  of  the  low  press\u3  steam  and  the 
total  amount  of  electricity  produced.  See  fig.  U. 

The  process  is  disturbed  by  first  order  flTtcred white  noise. 


Fig.  U Structure  of  ».he  process 
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EXPERIMENTAL  CORCITIORS 

The  task  of  the  operator  is  to  keep  the  three  .agitally  displayed  outputs 
vithin  the  specified  boundaries  using  one  or  more  of  the  three  setpoint 
control  inputs . 

High  pressure  nteam  is  displayed  continuously,  the  flow  and  pover  are 
displayed  on  request  during  5 seconds. 

Four  task  conditions  have  been  specified. 

The  system  disturbances  and  the  display  structure  were  varied  V'th  on  tvo 
levels,  keeping  the  task  to  be  performed  and  the  system  dynaiucs  the  same 
for  all  experiments. 

The  conditions  are  indicated  as  fbllovs.  a^  b^i,  a^  b2t  ^1 
a^  represents  a lev  levex  of  systmn  disturbances  and  a2  a high  It  . . • 
bi  stands  for  local  alana  which  means  that  the  operator  knows  exactly 
which  output  is  out  of  the  boundary  specified  and  in  what  direction. 

The  actual  value  of  the  flow  and  the  power  can  le  obtained  by  talLxng  a 
sample.  b2  stands  for  central  alarm.  This  means  .^at  tae  operator  onl. 
knows  that  one  or  more  outputs  are  beyond  the  limits.  Additional 
information  in  terms  of  the  requested  samples  is  required  to  determine  the 
actual  state  of  the  system.  It  has  been  assumed  before  that  the  supervisor 
has  a perfect  internal  representation,  which  means  that  his  behavior 
should  be  stationary  and  that  he  should  not  be  in  a learning  phase  anymore. 
Fig.  5 shows  86  sessions  of  ^he  total  of  123  sessions  of  U5  minute^  with 
one  subject.  Due  to  learning  effects  only  the  last  nine  sessions  ^ each 
condition  have  been  used  to  verify  the  postulated  hypotheses. 


160 


i 

I » 

I io 


n«20 

r • n.20 

g 1 

r . • n.23  r 

• 

• 

•••  •• 
^ . 

••• 

* • 

' • • • 

• • • • 

••  ••  •*  \ 
•••  • 

• 

* * • 

• ••  . 
• • 

• 

*•* 

• • . 

. 

► 

• 

a 

^ 

•• 

•% 

* 

* ••  *••• 

0 10  20 

• numtMT  of  control  actions 

• numbv  of  obsorvotion  actions 

•yig.  5 


n«23 


low  disturbonets  b,  local  olorm 
Oj  high  disturboncss 


numbor  of  sossions 


bj  control  otorm 


RESULTS 


Both  the  hypotheses  postulated  with  respect  to  sa^li::g  and  with  respect 
to  control  actions  were  found  to  be  true.  For  the  results  of  the  statistical 
analycis  of  the  data  we  refer  to  'i'able  2.  The  null  hypotheses  related  to  the 
mean  u (number  of  samples  and  control  actions  per  run)  is  tooted 
Hq:  f yn*  Since  it  is  not  known  whether  thfi  tvo  groups  to  be  compared 

have  the  s^me  vsj lance,  an  F^test  or  analysis  of  variance  of  the  sample 
variance  is  pe*  'imed.  The  null  hypotheses  if  now  9^  • 0^^  ar  ' a 
significance  . of  1 ■ .01  is  accepted  here. 

If  the  proba  i".  for  the  value  is  greater  than  a then  the  .‘^uU  hypotheses 
Ro:o^^  « is  $ peed.  The  significance  of  Hq  : 9^  U2  is  then  baaed  on 

the  probability  v«^ae  for  tbs  poolrd  variance  estimate.  If  the  probability 
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for  F is  lest  ttmn  or  eq;oal  to  ft  tbc&  tte  buXI  taypotbesos  8<>  : fti  * <>2 
rejected.  The  sicnificsnce  of  Ho  : ui  1^  «2  ftjctrftpolated  fro*  the 
sepftTftte  rftrisnce  estimte. 

fhhle  2 »-»•*» 


Fi«.  6 shows  the  S9%  relishilitj  interwsl  of  a T-5tiidcat  distribution 
fhr  esch  of  the  four  conditions. 

The  SMS  effects  hsre  been  found  on  a 95S  reXiability  intnrwal  with  a 
less  trained  subject. 

Fron  these  results  the  separate  effects  of  the  levels  of  the  tw>  task 
variables  on  the  b^wvior  of  the  sopcnrisor  are  clear. 

COnpariac  Fics.  6 and  7»  it  alho  follows  that  the  sobje^  increases 
his  Bonber  of  control  actions  when  the  systen  is  nore  disturbed » but 
he  does  not  chaace  the  wplitndes  of  the  control, 
the  average  snslitude  of  the  controlT  aetioos  seas  to  be  a fixed 
quantity  based  on  the  systa  dyaanies  and  the  given  task;  however,  these 
task  variablha  have  not  been  varied  daring  the  four  conditions. 

Using  the  Analysis  of  Tarisnee  for  sach  inpat,  it  alho  follows  that  for 
the  given  set  of  nessuraants  no  differences  in  the  neea  enplitude  can 
be  foond  (See  Fig.  7). 

Ve  can  concl*sde  that  changing  the  display  stroetore  does  not  influsnee  the 
xnatfm*  of  sea^les.  Chaziging  the  level  of  the  distorbsnees  does  have  an 
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Lafliimc^  on  thm  saapliag  bchaTior  «nd  tbc  iwatwr  of  control  actions, 
ftia  aeaa  anlitute  vill  not  chyan^  for  each  cooditioc:  only  wamm  cheaga 
of  tha  standard  dariatioa  dna  to  tha  disxwbaacas  do  occur. 


■URBUiH  B^SEABCH 

la  this  papar  tha  stated  hgrpotbasas  aara  tastad  and  found  to  ha  trua. 

In  fact  tha  surra>  daalt  vith  a 2 x 2 x 1 x t dasifn.  Bacaosa  tha 
*tash  rrrpiirimrnri*  and  tha  'systaK  dynanics*  haaa  not  ba«&  chanfad 
vithin  tha  fr^  conditions,  «a  plan  to  cha^  tha  task  raquirtMnts  for 
tha  next  apetiaants.  Tha  houndarias  spacifiad  vill  ha  dacraasad  vhila 
keaping  tha  other  cenditions  as  hafort. 

(hi  tha  basis  of  tha  structure  of  tha  nodal,  nav  hypotheses  hasa  hcan 
postulated  to  relate  tha  paraneters  of  the  di  Cerent  parts  of  tha  nodal 
to  tha  task  Tariaoles  nantioaad  before. 

These  nodal  hypotheses  are: 

o tha  paranst  rri  of  the  ohsaraar  part  art  indapandant  of  tha  supemsory 
task  and  are  only  a function  of  the  dynanics  of  tha  system,  the  structure 
of  tha  display  and  the  noise  partntiers. 
o the  paraneters  of  the  controller  part  are  independent  of  the  obserrati'^n 
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oroMss  ftod  %rm  only  a Amctioa  of  tte  djrniBics  of  tho  and 

tte  superrisorr  task. 

tkbX«  3 reprosoQta  tbo  postulated  ralatiooaliip  batuaan  task  variakiaa 
and  tlia  parsMtara  of  the  diffarant  parts  of  tka  aDdal*  Tte  cross  X 
■teas  dapaodsacy. 


Tkkia  3 

Oba*P.  D.O.  D.C*  Goatr.P. 

a)  fariatioas  of  tlia  lystas  disturbaacaa 

b)  Tariatioas  of  tbs  display 

c)  Tariatioas  of  tba  task  raqairsMats 

d)  Tariatioas  of  tbs  systam  dyasaics 


■art  to  tba  tba  parttar  idaatificatioa,  aora  subjaets  vill  ba 
iarasti^tad  to  iacraasa  tba  statistical  sigaificaaca  of  tbs  rasults 
Tba  fiaal  part  of  this  rasults  aill  ba  daalinf  aitb  tba  last 
task  aariabla  asatioiwd;  *tba  systM  dyasmcs*.  ^ tbsn  a eo^lata 
2 X 2 X 2 X 2 axpariasotal  dasi^  aill  ba  aceoaplisbad. 

BimMCXS 
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EFFECT  or  MFEinglAL  MOmOUK  AMO  7IGILAIICE 

Jaaic*  J.  (fry*  and  lanri.ck  S.  Cuny 

■ASA  Aaaa  laaaarch  Caacar,  Maffatc  Fiald,  CA 


MvAnceaents  In  AutoMtlng  ■ui*aich1ne  systcas  will  clwnge  the  role  of  the 
himn  aonltor.  Nuy  tredItlonAl  viglUnce  studies  ere  not  broed  enough  to  expose 
the  dec1s1on>wk1ng  nrocesses  Involved  In  Inferentlel  aonl taring  of  conplex 
vigilance  tasks.  In  order  to  Investigate  vigilance  probleas  In  aodeni  aan* 
■achine  systeas.  a paragiga  has  been  designed  to  assess  both  siwple  and  1nferen> 
tial  oonltorlng.  Ihe  paradlga  consists  of  a slaulated  heat*regu1ator  systea 
that  can  be  aanually  or  autoaatically  operated.  The  systea's  Indicators  will 
allow  nonltors  to  be  aware  of  systea  aal functioning  which  can  be  Inferred 
froa  oultlple  Infbnoitlon  soirees. 

The  ejgwrioental  situation  will  allow  varying  degrees  of  autoaatlon  In  a 
set  of  control  and  oonltorlng  tasks.  The  tasks  will  Involve  detection  of  oal> 
functions  and  varying  levels  of  decision-asking  to  correct  the  na1  functions. 

The  level  of  decision-asking  will  depend  on  the  level  of  autoastlon  allocated 
to  the  coaputer  or  to  the  huaan  aonltor.  The  first  set  of  eigiefiaents  will 
address  how  decision-asking  (In  teros  of  reaction  tloe  and  errors)  Is  affected 
by  task  coaplexlty  and  knowledge  of  results.  Stdijects  will  aonltor  1-hour  of 
slaple  systea  operation  with  no  Inferential  task  required.  The  simile  oonltorlng 
will  be  a detection  task  only.  They  will  also  aonltor  1-hour  of  systea  operation 
requiring  operational  decision  asking  In  a diagnostic  task.  Three  levels 
of  iCR  will  be  assigned  to  three  groups;  no  KR.  partial  KR.  and  total  KR. 

The  Initial  study  1$  design^  to  provide  Inforastlon  ^ut  the  following 
questions  with  respect  to  operational  aonltoring  tasks: 
a)  Does  perfomsnee  change.  Indicated  by  an  Increase  In  nwdter  of  errors  and 
response  tine,  during  a 1-hour  Inferential  oonltorlng  task? 
b4  dill  perfbmanoe  differ  between  sliqile  detection  task  and  Inferential 
diagnostic  task? 

c)  Does  KR  have  an  effect  on  the  ntoiter  of  errors  and  RT  during  « 1-hour 
Inferential  oonltorlng  task? 

Eighteen  naive  college  oen  will  serve  as  paid  volunteers  for  this  study. 

Each  subject  will  be  randoaly  assigned  to  one  of  three  groups:  no  KR,  par*t1al 
KR.  and  total  KR.  Analysis  of  the  data  will  be  a design  of  2(task  coaplexlty) 

X (feedback)  x 6(t1ae  segaents)  analysis  of  variance  with  repeated  oeasures 
on  task  conplexl^  and  tine.  Tnere  will  be  two  sets  of  experlaental  data.. The 
first  will  be  the  total  errors  fbr  each  teaporal  block.  The  second  will  be 
the  latenqr  of  each  response.  The  basic  data  will  be  collected  by  the  POP-12 
coaputer. 
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EFFECTS  OF  MOTIVATIQN  ON  CAR-POLLOaNG 


Tam  Bdsser 
PsycfaDlogisches  Institut  der 


IfestfiUisdien  WilhelK^JhiversitRt 
Schlauistr.2,  D-44  .HDnster 
Nest-GenuiK 


ABSTRACT^  Speed*  and  distance  control  by  autODbile-drivers 
is  described  best  by  linear  aodels  Wien  the  lead^  vehicles 
speed  varies  randomly  and  Wien  the  driver  is  aotivated  to 
a large  distance.  A caz^folloiring  experiJKnt  recpiired 
subjects  to  fiolloa  at  'safe*  or  at  'close*  distance.  Trans* 
fer^characteristics  of  the  driver  vere  extented  by  1 octave 
Wien  following  ’closely*  • Monlinear  properties  of  drivers 
control*aovenents  are  assuned  to  reflect  diffensit  notiva* 
tion*depmdent  control  strategies. 


I^f^ROD^CTION.  The  automobile  driver's  capability  to  control  speed 
and  distance  to  other  cars  is  of  considerable  iigxirtance  for  traffic* 
safety,  traffic  flow,  the  usable  capacity  of  the  hi^ftway*systen,  and 
partly  detemines  ftBl-consia9)tion.  Autonatisation  of  this  task  can 
not  be  expected  in  the  foreseeable  future,  even  then  a servo*syste» 
KJSt  be  adapted  to  existing  traffic  and  thus  requires  the  identifi* 
cation  of  huoan  control*behaviour  in  this  task. 

# 

Investigations  of  car-folicx«fing  by  DREYER  (1979)  and  HAIHWIQi  (1971) 
showed  that  driver's  control  of  speed  and  distance  in  real  and 
sifflulated  car-following*experiiBents  can  be  described  adeqiiately  by 
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linear  nodels,  wiiere  speed-difference  between  leading  and  following 
vehicle  and  distance  are  considered  to  be  the  iigjuts  to  the  driver. 

Frca  observations  of  driving  behaviour  under  natural  conditions 
on  the  notorway  in  an  instruKnted  vehicle  we  concluded  that  under 
these  conditions  driver's  speed-control  is  predictable  only  to  a 
snail  extent  by  linear  describing  functions. 

This  is  partly  due  to  the  variability  of  traffic  conditioner  which 
require  only  part  of  the  tine  to  follow  a leading  veh^c  Also 
distances  between  cars  on  average  are  nuch  shorter  than  those  observed 
in  other  expexinental  investigations » which  excludes  the  neccessity 
to  use  high-frequency  control-behaviour  in  order  to  avoid  collisions. 
LixKar  nodels  of  car- following  seen  to  describe  driver’s  behaviour 
bestr  when  the  speed  variations  of  the  leading  vehicle  can  not  be 
predicted  fron  traffic  further  ahead  or  fraa  the  course  of  the  road, 
idiich  imdar  ordinary  driving  conditions  is  possible  nost  of  the  tine. 
Linear  nodels  seen  to  be  deficient  in  diet  xhey  can  not  represent 
responses  to  step-lilce  changes  in  the  input  variables,  which  occur 
rarely,  but  are  of  great  ii^rtance  for  safe  driving.  Secondly  they 
do  not  represent  the  fact  that  perfoTnance-criteria  for  spaed-  and 
distance  control  in  driving  are  detemuied  by  the  driver’s  notivational 
state,  where  safety  considerations,  haste,  confbrt,  risk-taking  and 
cost  are  considered  and  an  optinal  course  is  detemined. 

^taual  control  experiaents  and  control  of  wore  expensive  vehicles  like 
aiq>lanes  differ  froa  driving  an  autonobile  in  that  motivation  can  be 
controlled  and  held  constant  in  these  situations.  The  aim  of  the 
investigation  reported  here  is  to  explore  the  influence  of  laotivational 
processes  on  car- following  performance. 


PftDCEDURE.  Experiments  were  carried  out  in  an  average  saloon-car  which 
was  instrumented  to  allowed  recording  of  speed,  throttleposition,  and 
ocher  variables  not  considered  here,  on  PQ4-tape.  In  addition  the 
traffic-situation  ahead  was  recorded  on  video-tape,  which  was  used  to 
determine  distance  to  the  leading  vehicle  by  an  online  photometric 
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technique.  For  enelysls  data  were  filtered  and  stored  with  a 
rate  of  2.93  Hz. 


A car*foIloMing  experiment  was  conducted  on  an  Infrequently  used  part 
of  the  HDtotMy  during  times  of  low  traffic.  Ihe  leading  car  varied 
its  speed  between  70  and  90  ki^h  according  to  a S^^level  VWS  with  a 
length  of  o3  intervals  and  a clock* frequency  of  0.2  thus  repre- 
senting a frequency  range  of  .1  to  .006  Hz. 

The  properties  of  this  test-sequences  were  selected  to  allow  identifi- 
cation of  behaviour  in  the  high* frequency* range.  Eight  subjects 
(experienced  driven)  followed  this  course  four  times » twice  with  the 
instruction  to  follow  at  a *safe*  distance  and  twice  at  'close*  distance. 

Data  obtained  were  analyzed  in  the  frequency-danain  with  FFT* 

Rrocedures  (BENDfkT  4 PIERSOL,  1971). 

RESULTS.  The  ftaictions  shown  are  averages  of  8 subjects.  Distance 
between  can  is  wch  lower  under  'close*  condition  (Fig.  1.  Mote  that 
measurement  of  short  distances  was  limited  by  the  field  of  view  of 
the  video  camera,  thus  zero*distance  represents  a distance  ^ 3m.)  Power 
spectral  density  of  distance  is  reduced  accordingly  over  the  whole 
frequency* rax)ge  represented  in  the  signal  under  the  'close*  condition 
(Fig.  2).  Power  spectral  density  of  speed  shows  that  the  'close* 
condition  introduces  more  hi^*frequency  variance  and  reduces  low- 
frequency  variance  (Fig.  3).  Throttle  position,  which  is  the  essential 
output-variable  of  the  driver  for  speed*  and  distance-control,  shows  a 
probability^distribution  with  a lower  peak  and  more  frequent  occurrence 
cf  extreme  throttle-positions  (Fig.  4).  indicating  maximum* force  control 
and  a time-optimal  strategy.  Power  spectrum  of  throttle  position  (Fig.  5) 
shows  that  high-frequency-power  is  jJKreased  by  the  instruction  to 
follow  closely.  Coherence  between  the  distance  to  the  leading  v^icle  - 
the  essential  input  variable  for  the  driver  * and  throttle  position 
shows  that  the  transfer-characteristics  of  the  driver  are  extended 
through  the  instruction  to  follow  at  close  distance  by  approximately  one 
octave  (Fig.  6). 
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DISQgSION>  Results  denonstrmte  that  huHn  control*behaviour  defiends  on 
aotivation,  which  was  varied  in  this  case  by  instructing  the  driver. 

In  the  present  experiaents  the  trans£erM±aracteristic$  of  the  driver 
extended  to  a higher  frequency^range  than  was  found  in  other  investi- 
gations. Ihis  can  be  assuaed  to  be  due  to  the  fact  that  in  these 
investigations  different  input-signals  to  the  driver  were  generated^ 
where  through  preview  the  driver  was  able  to  control  speed  adequately 
by  avoiding  the  neccessity  for  high-frequency  control  behaviour.  This 
was  not  possible  in  the  present  case,  as  speed  variations  of  the 
leading  v^cle  were  not  predictable* 

Distances  between  vehicles  under  natural  driving  conditions  are  aore 
sinilar  to  distances  observed  under  the  'close*  condition.  This  can 
also  be  attributed  to  the  fact  that  nonal  traffic-conditions  allow 
prediction  of  speed-changes  ahead  and  thus  allow  drivers  to  be  confi- 
dent of  their  ability  to  control  these  short  distances  without  neccessity 
of  high* frequency  control-behaviour. 

Nhereas  in  the  loif^frequency  range  driver's  control  noxn—nts  can  be 
appnsudmted  by  linear  nodels,  a large  proportion  of  the  high-frequency 
power  contained  in  the  signals  recorded  is  not  related  in  a linear 
fashion  to  the  input  signal*  This  any  be  due  to  nonlinear  control- 
strategies,  e.g.  'bang*bang* -control  or  adaptive  processes  like  those 
proposed  by  OOSTELLO  (1968).  It  is  highly  plausible  to  assiaee  a non- 
linear asywnetric  weighting  of  the  error  in  the  control  of  distance 
between  vehicles  - a large  distance  does  not  lead  to  undesirable  con- 
sequences, short  distance  however  represents  a highly  dangerous 
situation  and  my  introduce  a nonlinear  strategy  to  avoid  this  situation. 

Although  the  instruction  to  follow  'closely'  introduces  hi|di*frequency 
power  into  the  throttle-signal,  a considerable  proportion  is  contained 
in  the  signal  under  the  'safe*  conditions.  The  throttle-signal  was 
predicted  froei  the  estimted  nonparanetric  transfer-function  and  the 
distance  to  the  leading  car.  Fig.  7 shows  this  for  one  subject  under 
'close'  and  'safe'  following.  It  can  be  seen  that  high-frequency  varia- 
tions iff\der  the  'safe'  condition  are  present,  but  not  related  linearly 
to  distance.  In  coaparison  under  the  'close'  conditions  these  high- 
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frequency  actions  are  highly  correlated  with  the  input-signal,  as  is 
represented  by  the  coherence- function.  This  indicates  that  the  change 
in  control-activity  can  be  described  partly  by  the  synchronisation  of 
the  hi^-frequency  control  movements  to  the  input-signal.  All  subjects 
reported  driving  under  the  'close'  condition  to  be  highly  strainful 
and  mich  more  difficult  than  nomal  driving.  Me  can  therefore  conclude 
hypothetically,  that  drivers  adjust  their  cantrtl-actlvities  to  the 
input-signals  in  such  a way  as  to  make  high~^re<|UBncy  cjntrol  unnecessaiy. 
This  can  be  achieved  by  increasing  the  set  point  for  distance  to  the 
leading  vehicle  and  giving  low  weight  to  deviations  of  distance  from 
setpoint.  Nonlinear  properties  of  control  behaviour  with  'safe'  distance 
nay  reflect  a control  strategy  reducing  workload,  whereas  nonlinear 
properties  cf  'close'  following  represent  a tine-optiaal  strategy. 

Motivational  variables  can  be  asswod  to  lisdt  the  adaptability  of 

the  driver  to  traffic-conditions  and  to  properties  of  the  v^icle  and 

the  road  beyond  the  liiaitations  represented  by  the  perceptual-motor  system. 
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ABSiatACT 

A schoMtic  deocripitiaa  of  tho  mt^ezxns  control  process  is  presented.  It  is 
s*Knm  that  this  process  csn  be  dtscribed  in  tens  of  levels  of  control.  Level 
of  control  sill  dspend  on  driver's  skill  in  ■eking  use  of  'clever*  strntegies 
vhiai  asy  be  related  to  kaovledgs  sbout  the  path  to  foUov  (input)  and/or  tbe  ve- 
hicle under  control.  This  kacsrledgs  aer  be  referred  to  as  an  internal  aodel  of 
a particular  task  eleunt.  Internal  infbmation*  as  derived  ftou  these  inter- 
nal aodels  vill  prbbably  be  used  together  vith  proprioceptive  feedback.  It  is 
hypothesised  that  the  efficiency  of  the  hitfier  levels  of  control  vill  be  de- 
pendent on  the  accuracy  of  both  the  internal  and  proprioceptive  infdnation. 
Based  on  this  resear^  philosophy  a series  of  esperiaents  is  cerried  out. 

Tuo  preliainazy  ezperiaents  vere  done  in  order  to  snalyse  subjects'  ability 
to  reproduce  steering-v&eel  posit iona  and  aDvenants  vithout  visual  feedback. 
Steering-wheel  angle  asplitude*  steering  force  and  aovencnt  frequency  vere 
involved  as  independant  variables. 


T.  mODOCTlOl 

The  desiffi  of  a aafe  traffic  system  requires  a good  understanding  of  tha  ele- 
aents  in  the  system.  In  aixtoaobile  driving  these  eleaants  are  the  driver,  the 
vehicle  and  the  roadway  environaant.  The  latter  two  elaaenta  serve  as  the  sys- 
tem to  be  controlled  by  the  driver.  Tehicle  end  environaental  ehsracteristics 
csn  be  given  in  aathewtical  terns  snd  the  xaderstanding  of  both  these  ele- 
ments is  fairly  good.  Hovevert  optimsation  of  vehicle  and  snTironBsntal  ehsr- 
scteristics  can  only  be  aade  given  sufficient  knovledge  sbout  driver's  capabi- 
lities. It  is  useful  to  distinguish  three  main  aspects  of  a driver's  task: 
navigation,  guidance  sad  vehicle  control*  Bavigation  deals  vith  route  selec- 
tion. Guidance  involves  the  processing  of  inforaation  on  other  vehicle  no- 
tions, obstacle  location,  road  geometry  etc.  leading  to  the  desired  vehicle 
speed  and  path.  Finally,  vehicle  control  iiplies  the  processes  of  speed  and 
path  (or  steering-)  control  itself.  Ve  vill  mainly  pay  attention  to  the  driv- 
er's capabilities  in  steering  control* 

Steering  control  tasks  can  be  d*  ^bed  in  terms  of  levels  of  omtrol  (Krendel 
and  HcBuer^,  Fev^,  McRuer  et  al.^,  Oonges*').  Levels  of  control  are  related  to 
the  use  ot  aore  or  less  'clever*  strategiaa.  Strategies  cquld  be  of  a percep- 
tual nature,  for  exa^>le  when  preview  is  used.  Strategies  could  also  be  of  a 
cognitive  origin  when  drivers  use  internal  representations  or  models  sbout  the 
vehicle  under  control  and/or  abotxt  environaental  propertias  sv^h  as  road  geo- 
metry. 
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Th«  ia  Fig.  i giim  a hqrpotb— ifd»  sctewtie  dfscriptioa  of  tbo 

ttaoriag  control  procooo  (too  nloo  Croadol  ob4  NcBuor^).  Drivtra  ootiaation  I 
about  tho  input  or  path  r n— nil  vill  bo  boood  on  Tisunllx  porcoiood,  oxtoronX 
infbrmtioo  oad/or  iatomal  input  infbnwtioa  ii  which  is  doriwod  ftoa  tho 
Intorasl  Nodol  about  tho  Input  eharaetoristies  IKt.  Xxtoraal  input  infonation 
■oar  contain  prowiow.  Intornal  inftraation  will  also  aUctr  tho  driwtr  to  naho 
prodictions  about  i. 

Qrivors  estiaation  0 about  tho  output  or  wthielo  aotions  o will  bo  basod  on 
visually  poreoivod,  oxtoinial  inforaation  o«  and/or  on  intonal  input  infbraa- 
tion  oi-  This  lattor  typo  of  infOraation  will  bo  a rosult  of  an  intoxplay  bo* 
twoon  nanual  foodbach  inforaation  a and  drivar*s  Intornal  IMol  about  tho  Vo* 
hi  do  (y)  oharactodctiea 

procogrwfivo 


It  is  bypothosisod  that  lovol  of  control  in  a particular  staoring  task  will 
aainly  bo  govwmod  by  tho  availability  of  tho  abovw  asntionod  typos  of  infbr* 
aation*  At  tho  highost,  proco^iitivo  lovol  drivors  aaho  uso  of  thoir  oxpori* 
ones  with  tho  saas  typo  of  task  conditions.  i«o«  thoir  intornal  aodsls  about 
tho  input  and  tho  vohielo  proportios  • This  oxporionco  will  load  to  tho  dsvolop* 
oant  of  a Motor  Rosponso  (IM)  which  storos  tho  spocifications  \ of 

tho  asmal  eontxol  actions  that  should  bo  aado  utidor  tho  particular  conditions. 
AltNough  Schaidt^  liaits  tho  validity  of  his  schsas  thoory  to  tho  loaming  of 
eiccroto  aovoasnts  it  is  assuasd  horo  that  co^parablo  principlos  will  play  a 
rolo  in  continuous  tasks.  Whan  tho  prodietability  of  X is  linitod  • dus  to  tho 
structuro  of  i^  or  dus  to  sbssneo  of  INI  - drivors  any  still  uso  thoir  knowl- 
odgo  about  tho  vohielo  characteristics.  Control  will  taka  place  at  tho  pursuit 
level  under  those  eircunstancos  • Boro  drivors  vill  gsnorato  dssirod  aanial  con- 
trol actions  Mp  using  I (with  its  reduced  predictability)  as  input  and  relying 
on  the  internal  nodol  about  tho  dynanies  of  tho  vehicle  tndsr  control  (INfi) 
as  a neons  of  weighting  botvoon  I and  Np. 

It  nay  be  hypothesised  that  drivers  prinarily  vill  gonorato  control  actions  a 
based  on  Mg  or  Np.  Only  when  those  control  nodes  load  to  vehicle  aotions  0 
that  * conpared  'to  I * show  an  error  I which  is  beyond  driver *s  criterion, 
tho  co^onsatory  level  of  control  cones  into  operation.  It  ia  at  this  lowest 
Isvel  of  control  that  drivers  gensrate  corrections  on  the  desired  nsnual 
control  actions. 

It  is  suggested  that  the  attentional  dsnsnds  of  a particular  steering  task  de- 
pend on  level  of  control.  At  the  highest  level  steering  ia  as  an  sutoaatic  or 
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*op«n  loop*  procoss.  vterMS  «t  tte  lowor  loirola  stooria^  is  aors  *closod  loop* 
or  yndor  cooseioos  control*  Coapnsotoxy  stMriac  has  boon  studiod  la  asaj 
tasks  sad  control  b^mviour  at  this  Istnl  is  rathar  vail  kaom  (Fov^^NeRuar 
St  al*^).  Tbs  cbaraetsristics  of  tbs  pursuit  Isvsl  in  stssrinc  an  autonobila 
vars  illustratsd  by  McRusr  at  al*  ^ and  Doncss^  • furtbsr  dascription  sspacially 
vith  racard  to  ths  ralativs  i^ortanes  of  ths  pursuit  and  conpanaatory  lasal 
ara  nacassazy. 

Vary  littla  is  knoim  about  staarinc  tasks  in  vbich  aotor  procrans  ara  uaad* 

**It  is  at  this  laval  that  our  undarstandinc  and  nodals  ara  aost  inconplata** 
(Pev^). 

In  tha  presant  studf  tna  praco^iitisa  and  pursuit  lavtls  of  control  vill  ba 
subjactad  to  furthar  analysis.  Spacial  attantion  vill  ba  c^van  to  propriocap- 
ti^  faadback,  tbaraby  considarinc  tha  rola  of  staarinc  forca  or  ^cootrol  tbal* 
in  particular.  Fav  quantitativa  data  ara  availabla  on  this  lattar  point  and  it 
is  ezpactad  that  tha  dascribad  aodsl  vill  fiva  tha  opportunity  to  quantify  tha 
rola  of  control  faal  as  a part  of  tha  propriocaptiva  information  on  n.  Balatad 
to  this  is  tha  quaation  of  tha  ralative  inportsnca  of  risual  snd  proprioeap* 
tiva  faadback  at  tha  diffsrant  \avals  of  control.  Can  tha  intarplay  batvaan 
tha  propriocaptiva  systan  and  tha  MS  and  DlV-blocka  raduea  tha  load  put  on 
tha  visual  systan?  Convarsaly  it  can  ba  quaationad  hov  tha  mount  of  visual 
attantion  raquirad  for  a particular  staarinc  task  can  ba  infXuancad  by  aalact* 
in%  tha  propar  input  and/or  wbicla  cbarsctaristica. 

Lat  us  sasin  considar  tha  disarsn  of  Fif.  1.  In  tha  procaas  of  transfarrina 
inputs  i into  mnuni  control  actions  n»  thraa  nsjor  subprocassas  sra  - hypo- 
tbaticslly  - distinauisbad: 

1.  On  tha  parcaptual  aids  tbara  is  t^a  transfomstion  fron  input  i and  output  o 
into  tha  astination  I and  0. 

2.  Thasa  astimtions  should  ba  translatad  into  tha  spacifications  for  tha  da* 
airad  asnual  control  actions  N.  Spacifications  nay  involva  nanual  forca  • 
position,  valocity  ( lining)  and  sccalaration.  At  this  cantral  part  of  tha 
procaas  tha  MSS  and/or  blocks  vill  play  a rola. 

3.  Finally  on  tha  motor  aids,  tha  trsnsfozmtion  fron  dasirad  (M)  to  tusl  (■) 

control  action  takas  plsca.  As  shovn  in  Fig.  l it  is  suggastad  thSw  a pro* 
priocaptiw  faadback  path  is  in  operation  at  this  point,  co^anss- 

tory  corrections  on  tha  trsnsfoxnation  from  H to  n. 

Tha  opa^ators'  skill  in  each  of  these  subprocassas  vill  ultinataly  dataznina 
tha  efficiency  of  tha  pracognitiva  and/or  pursvdt  level  of  control. 

Sjcpariasnts  under  way  nov  deal  vith  tracking  predictable  and  unpradictahla  in* 
puts  under  partially  occluded  conditions.  In  this  vay  tha  dagraa  to  vhich  in* 
tamal  and  axtamal  information  ara  available  (and  thus  laval  of  control)  is 
arpariatntally  varied. 

Tha  present  paper  describes  tvo  preliminary  axparimants  vhich  vara  dona  in 
order  to  gat  quantitative  data  about  subjects*  shility  to  trsnsform  dasirad 
(N)  to  actual  (■)  manual  control  actions.  In  a reproduction  task  subjects 
reproduced  diserata  and  continuous  staaring-vhaal  aovamnts.  These  relatively 
simple  tasks  vara  choaan  to  gat  a first  impression  of  tha  influence  of  tha 
folloving  indapandant  variables:  ataaring-vhaal  movamtnt  amplitude,  frequency 
and  steariog  force. 

2.  EXFEHIME::^  I:  REPHODUCTIOH  of  DISCRETE  STEERI71G*WHESL  MDVEXEBTS 
2.1  Background 

Experiment  I vas  designed  to  collect  qxiantitative  data  about  tha  N to  m trans* 
formation  in  a discrete  positioning  task. 

In  a reproduction  experiment  siibjects  laamad  a discrete  stearing-vhaal  move* 
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■tut  «nd  thm  ability  to  reproduco  this  aoiMant  vaa  asasurad.  As  iadicatad  in 
tha  iotroductioa  tha  raaults  of  this  N to  a transfaraation  aitfit  ba  usafol  ia 
a^raluatin^  tha  rola  of  tha  praco^iitiaa  sad  pursuit  laaals  of  eoatrol  in  staar* 
in^  tasks. 

Literat\ire  shows  a nuaber  of  expariaents  in  which  stibjects  had  to  raproduca  hand/ 
arm  aowaxcnts  undar  constrainad  conditions . Tha  purposa  of  aost  of  thasa  aspar* 
iasnts  was  to  analjza  tha  function  of  sawaral  typas  of  faadbach  euas.  k dis* 
tinction  can  ba  aada  betvaan  position^  solitude • tiaa,  salocity  and  fbrea  as 
covenants  of  individual  raprasantartion  of  a aovaint.  Gundzy^  illustratad 
that  with  lone  (in  taras  of  distanca)  apvaaants  swbjacts  usa  aainly  position 
infbraatioD*  whiXo  with  short  aowsaants  saplituds  (tiaa  x valocity)  inforasstion 
baeosM  aora  pronoxacad*  Adaas  at  al.^  soaljxad  tha  ralativa  ii^ortanea  of 
visual  and  propriocaptiva  (fbrea)  faadbach  in  laaminc  a discrata  aanml  aova« 
aent.  In  thair  axpariaant  tha  **ola  of  tha  force  eua  aa  a coapooant  of  sub* 
jact*s  skill  in  rairodaetion  was  illustratad.  Bowavar,  it  appaazed  that  tha 
afficiency  of  this  faadbach  cuts  aifht  ba  attanuatad  whan  laaminc  tahaa  placa 
with  visual  and  propriocaptiva  faadbach  coabinad.  Tha  prasant  azpariamt  was 
desired  such  thst  tha  affect  of  aryfumt  lancth  and  staarint  force  on  tha  ae* 
curacy  of  aosanant  raproduction  could  ba  evaluated.  ' 

2.2  Mathod 
2.2.1 

Twelve  nala  svbjacta  (Sa)  participated  in  tha  ajparinant,  all  of  than  univer- 
sity studanta*  Ss  ranpad  in  a^a  trom  20  to  3^  yaara.  All  Sa  had  thair  driving 
license  for  at  laaat  two  years.  All  Ss  vara  ri^t*haadad»  althou^  three  sub* 
jacta  indicated  that  this  priority  was  not  vary  pronoiBcad. 

2*2.2  Irmtrmmntatim 

Tha  axparinant  was  carried  out  in  tha  noeh-up  of  tha  driving  ainulator  of  tha 
Institute  or  Perception.  This  noch-up  ia  a Volvo  ^kk  with  its  original  ataar* 
inc  vhf  with  a 0*22  n radius.  Spohss  are  nEnnitad  in  tha  wheal  at  56*5  dacraaa 
to  tha  left  and  to  the'  rifht  fkon  tha  axis  connactind  tha  ivpar  and  lowest 
point  of  tha  wheal.  Tha  an$Ia  between  tha  ataarinc-whaal  plana  and  tha  vertical 
axis  throuah  the  rentra  of  tha  wheal  ia  15  dagraaa*  Tha  ataarinn  wheal  axis  is 
connected  with  a potantionatar  which  naeauraa  tha  staarinf*whaal  ancla  contin* 
uoualy.  Staarina  force  ia  fanaratad  by  naans  of  sn  alactric  torque  notor*  Axen 
MV19»  dich  is  connactad  with  tha  ataarina  wheal  axis  by  a aoorbalt  drive. 

2.2.3  Exp^rimf'.ital  aonditierm 

In  a with  r^’-aub jacta  desist  Sa  raprodoc^  four  staarinp-whaal  positions*  Tha 
^sitions  ^ 30^  to  tha  left  (6g  * *30”)  and  10^,  30  and  50^  to  tha  ri^t 

(6,  ■ 0^,  30^,  50^).  Tha  novenanta  had  to  ba  rwproduead  in  coibination  with 
thr  «*tearina-whaal  rin  force  lavwla  i.a.  0 R,  7*5  R and  15  Rt  aivina  a total 
aua.jar  of  12  novenant  conditions.  For  tha  ataarina*forca  conditions  tha  rala* 
.ion  batvaan  staarina^rtiaal  anala  and  ataarina  fbrea  was  linear*  i.a*  tha  wheal 
was  apri&a-cantarad. 

2.2.U  Pr^owdurw 

Subjects  vara  blindfolded  durina  the  axparinant.  Tha  teat  was  adjusted  to  that 
Ss  could  c<"nfortabIy  hold  tha  ataarina  vhc^l  with  thair  ann  slichtly  bant.  Sa 
vara  inrtructad  to  hold  tha  ataarina  wheal  auch  that  thair  th\nba  raatad  on  tha 
upper  left  and  right  apohas. 
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Tbit  ssperiatnt  took  tlx  dt^  vith  two  St  portieipxtiat  oo  toch  dox*  £tch  dty 
vmt  dividtd  in  2k  blocks*  Tbs  two  St  mltsnttiwtix  psrfbnsd  % block*  In  t 
block  tb''  stM  aowMsnt  wts  prstsstsd  tod  rsprodnesd  for  ko  couscutiws  trials* 
Ssqusncs  of  sowtasot  conditions  wms  mndosL;^  cnmr  Sri.  In  nil  conditions  tbs 
csntrt  position  of  tbs  stesrinf  wbssl  (d,  « 0^)  ssrwtd  ns  tbs  stnrtinc  point* 

In  sseb  trial  S sctiTsIx  aorsd  tbs  stssrins  idissl  to  n stiaulus  position  anrk- 
^ bj  nn  nuditorx  sicnsl*  Actusllj*  tbs  simsl  ssrksd  tn  srsn  of  plus  and  ainus 
around  tbs  stiaulus  anfls*  Than  Ss  sowsd  tbs  stssrinc  wbssl  bsck  to  tbs 
starting  position  which  vns  narked  by  a stop.  Msxt  to  this  stiaolus  presenta- 
tion Ss  were  required  to  reproduce  tbs  aoTsnsnt  ss  nccximtsly  ss  possible  with- 
out  tbs  sid  of  tbs  wsminc  sifpni.  Thus  one  trial  consisted  of  a criterion  (or 
sttMilas)  nDTsasat  and  a subsequent  reproduction  (or  rsapmisa)  noweaent. 

K block  of  bo  trials  of  a particular  noweaent  condition  lasted  about  1$  ain. 

2.2.5  Ozta  emalynis 

Both  stiaulus  and  reaporsa  angle  were  recorded.  Naans  and  standard  dewiations 
for  the  stiaulus  and  respcnae  angles  as  well  as  the  algebraic  error  were  cal- 
culated ower  the  last  25  trials  of  each  block*  The  difference  between  stiaulus 
and  response  within  a trial  was.  taken  as  algebraic  error*  Fsrforaance  on  the 
first  15  trials  waa  not  taken  into  the  final  analyaia  in  order  to  owercoaa 
habituation  and/or  transfer  affects  and  tar  the  sake  of  correspondence  with 
the  data  snalxsis  of  experiaent  II*  Differences  in  aeens  and  standard  dewisi- 
tiooa  were  tested  by  analysis  of  variance  (A0O?A). 

2*3  Beaulta 

Reeulta  showed  no  differences  between  the  30^  acveamt  to  the  left  and  tbs 
rigb^.  Therefore,  only  the  results  fdr  the  ridb^ward  aoveaent  will  be  discus- 
sed, see  fig.  2.  The  general  overshoot  effect  fbr  the  aeens  turned  out  to  be 
si^dficsnt  (p<0.0l).  Analysing  the  algebraic  errors  it  turned  out  that  the 
tendency  exists  for  the  overshoot  effect  to  be  shout  equal  for  the  30^  and  50^ 
aoveasnts  end  less  for  the  10^  aoveasnt.  An  AlOVA  on  the  algebraic  errors  in- 
dicated that  the  interaction,  steering^eel  angle  x steering  force,  was  not 
siffiificsnt.  However,  when  wly  the  10^  aoveaent  conditions  were  considered  a 
sigsificant  effect  (p<0.05)  of  steering  force  was  found,  indicating  en  in- 
creased overshoot  tendency  with  the  greatest  steering  force. 


Fig.  2 Nssna  sad  standard  deviations  of  the  stimulus  (S)  sad  response  (H) 
aoveaents  for  the  aoveaent  conditions  in  Experiaent  I. 
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2 thm  vaiiAtioD  of  tiM  itAaiiMi 

■OTMuit  coodition.  Fbr  tli«  ^▼x^tioea  as  a fuaetioii  of 

•®€i*  *»•  tidiuflcaiit  (t)<c  A|  iocrtaso  of  the  SD  vith  staoriaa 

ia«  fbrca  (p^S)  in^cSee  t^rSSllrd  of^U«^ 

^•n  stasrxac  forca  ira^aTIaJS?  xa  raspoasa.  dacraasa 

2.^  Discii^sjon 

sSHSS=iiS=£  ■fS£==rE.r 

■ tb*rt)7  usisc  th«  Stairmd  at^im  m P”****  tuamntiag  « eontrol  action 
<«0«l»qr  ,.  tt.  » ««1  - «» 

Tha  oaarau  <tepand«iiey  on  ^guftcant  owrahoot  affaet. 

0«iljr  at  tha  ataariiia^hti^  ®f  *5^*  not  ai*iificant. 

OTartooot  tantencr  an  comma  fT*’*^**^  “ * Mnil  incraaaa  ot  tfaa 

tha  ovarahoot  taadascy  in  at— inii»-ft,rji^i  condition.  Obaioualjr. 

tha  l*r„rt  ataarinT^ -oyaMnt* laa«th.  i.a.  ^ 

2*»  it  najr  ba  aapactad  that  vith  aterTMvaMt^i  *I?fc******  **  in  pn^- 

locity  ia  vaiy  ii^rtant.  Tb*  mtmlrill  contjrol  or  aovaMnt  va- 

d«tion  atiflfaata  that  ataariac  noTMaat  rajiro* 

With  recard  to  reproduction  accuracy  the  data  — »»eaant  vnlocity. 

« or  treat  iaportanea.  BotrST3n2!hJ^\^.^**’^'^  “ rap^tion 
«t  force  ahowad  a ai^uricaat  aTTaet  on  tiu  lancth)  and  ataar>- 

•ncs.  Stsndard  dsTiaticos  shoir  s riasihiiii  ■ in  xa  rsspoass  porforsH 

’rtiaal  anclaa  taku  into  conaidaratio^^toilvii^I!^  ®’**‘  •taaria*- 

•bUity  vith  “ ranpoanaTST 

itjr  or  ataarinc  fOrcTaTin  SSi^  «**  ‘^nhii- 

ity.  tha  ralativa  iMortanea  of  thi.  diainiah  raapoaaa  rariabia- 

lA  4 coBbinotioQ  of  aoT^^nt  ^orcs  •fftct  vill  hoTo  its 

«pariMnt.  are  aaad«|  to  ,i,a  datauIS^J^aS^S^  •«»cta.  Purthar 

2*o?'aS«2ca'^*2^£„^  M muat^tad  hara  ai.ht 

layel  of  control  ia  continuoua  ataarinc  «-aakt  ^ a purauit 

coatinuoua  taaka  an  aasariMBt  viu  1*  * diacrata  tovarda 

continuoua  aovaMata  w atudiad.  <*i«c»«*ad  nov  in  vhich  reproduction  of 

3.  OPEROfflrr  II:  RKPROBOCTia  OP  COWITODOS  STnRlK-WHm,  jcvomrs 
3*  ^ Bsc^sroiyid 

KipariMnt  II  vaa  carried  out  in  order  to  analrza  «.•  m - 

a coatinuoua  tank.  Sc  laartiad  an  iaolatad  i*nnarowation  in 

input  (atijBUua).  Sa*  ability  in  nhapad  vvaMnt  vith  yiaual 

eluded  conditiona  vaa  analyaad  StaM^I^^  »^»aent  (raaponaa)  under  oc- 

•nd  "taarinc-vhaallSySMS  «*~-in«  force 

fer  fro.  daairad  (M}  to  SSl^  "f  “ <»^  ^ha  trana- 

J^rs  could  siso  plsy  4 role.  tions.  Vslocxty  4ad/or  timing  sr* 
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Vossius^  analyzed  tiaing  aspecta  of  precosaitiTe  control  ladar  occluded  coodi« 
tioos.  Ss  leaned  a continuoua  aovuent  patten  wdar  Tisual  purauLt  caaditions 
and  reproduced  the  aoTeaeiit  vith  'lighta  out'.  The  'open  loop'  generated  aore^ 
sent  patten  laated  about  ^0%  Xonger  than  the  atisilua  aoteaent.  The  question 
reaained  whether  thia  tiadng-o'fershoot  effect  la  related  to: 

U correct  aoireaent  Telocity /poaition  OTershoot  or 
2.  aoeeaent  Telocity  mderahoot /correct  poaitioning. 

Experiment  II  should  giTe  more  data  on  this  point. 

In  'conTentional'  sine-waTe  tracking  experiments  it  has  been  illiaatrated  (Pev 
et  al«^^,  Magdaleno  et  al.^^)  that  below  frequencies  of  0-5  Hz  error  detection 
and  correction  mechanisma  play  an  important  role,  while  at  higher  frequencies 
tracking  behsTiour  becomes  more  and  more  autonomous  i.e.  with  the  aid  of  pat- 
ten-generation  mechanisms.  Although  both  frequency  and  moTement  aaplitude 
(together  resulting  in  a specific  moTement  Telocity)  will  be  of  iqortance,  it 
may  be  expected  that  these  phenomena  will  affect  preco^iitiTe  control.  As  a 
consequence  it  may  be  suggested  that  in  'rapid'  morements  the  loss  of  riaual 
guidance  (occlusion)  will  be  less  detrimental  than  in  slow  moTements.  Besides, 
it  may  be  expected  that  the  role  of  the  proprioceptire  system  in  the  overall 
accuracy  of  responses  will  be  limited  in  the  more  rapid  moTements.  Coasequoit- 
ly,  the  availability  of  an  additional  cue  like  steering  force  could  be  most  ef- 
fectiTe  in  slow  morements.  Vhether  this  suggestion  is  ralid  will,  of  course, 
depend  on  the  role  of  steering  force  in  rapid  moTements.  From  a perceptual 
point  of  view  this  role  may  be  limited.  Howerer,  the  functioning  of  steering 
force  in  rapid  morements  is  largely  unknown  and  steering  forces  could  hare  a 
stabilizing  effect  on  the  execution  of  this  type  of  morements. 

3.2  Method 

3.2.1  Subj€Ot9 

Twenty-four  male  Ss  participated  in  the  experiment.  All  of  them  were  unirersity 
students.  Ss  ranged  in  age  ffom  20  to  30  years.  All  Ss  had  their  driving  license 
for  at  least  two  years,  lone  of  them  took  part  in  Experiment  I.  AH  Ss  were 
right-handed,  although  four  Ss  indicated  that  this  priority  was  not  very  pro- 
nounced. 

3.2.2  In^tnmmttatum 

The  ej^riments  were  carried  out  in  the  same  mock-^  as  used  in  Experiment  I. 

As  stimulus  morement  a visual  ptnrsuit  tracking  task  was  used.  Visual  presenta- 
tions were  made  with  the  aid  of  a TV  projector  which  was  situated  above  the 
car.  Two  vertical  lines,  were  projected  on  a screen  situated  at  2.90  m in 
front  of  Ss'  head  position.  The  upper  vertical  lide  served  as  the  target  while 
the  lover  was  controlled  by  the  S.  The  lines  were  projected  just  above  and  be- 
low Ss'  eye  hei^t,this  latter  height  being  1.20  m.  The  height  of  the  vertical 
lines  was  19  cm  with  an  interspace  of  2 cm.  Line  width  was  3*5  cm.  The  gain  be- 
tween Ss'  cursor  and  steering-wheel  angle  was  1.12  cm  lateral  displacement 
(0.22  degrees  of  visual  angle)  per  degree  of  steering-wheel  angle. 

3.2.3  Exp^rimtntal  aonditicnB 

In  a partly  within-  partly  between-subjects  design  Ss  reproduced  six  steering- 
wheel  movements.  The  movement  pattern  was  based  on  a sine  wave  with  a modifi- 
cation at  the  start  and  end  of  the  movement.  Fig.  3a  shows  the  movement  pattern 
described  in  terms  of  steering-wheel  angle  amplitude  SA  and  frequency  F,  The 
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Fig.  3 Stiaxilua  pattam  and  raaponsa  aDAlysia  for  aoiriBanta  la  SipariMat  II. 
SA  ■ ttaariag-ahaal  aagXa  aaplitute; 

P • f^raquaaoy  (Hs); 

« • fWquaacy  (rad/'sac); 

• calculated  ao’rtaaat  tim  (t) 

Stiaulus  pattern  can  be  described  as: 

0 < t < 1/6F  : 6,  • SA  (1  - cos  at) 

\/6f  < t < 1/F:  6^  • SA  sia  (at  - »/6) 

1/F  < t < 7/6F:  6,  • SA  {cos(at  - »/3)  - D 


first  part  of  the  aoveasat  vas  to  the  left.  Begia  sad  sad  aodiflcatioas  were 
■ate  in  orter  to  hare  a saooth  aDeeasnt  pattern.  Three  solitudes  i.e.  10^, 

30^  end  50^  sad  two  frequencies  i.e.  0.2  Hs  (O.U  v rmd/s)  sad  0.5  Hs  (w  ra^s) 
were  tshen  into  coasiteratioa,  giriag  a total  axaber  of  six  steeriag-erheel 
■oweaent  patterns.  Duratioos  of  the  0.2  Hs  and  0.5  Hs  ■oweasats  were  5^  sec  sad 
2^  sec  respectiTsly.  Frequency  serted  ss  the  between«subjects  earisble  so  that 
12  Ss  reproduced  the  0.2  Hs  aoreasntSt  while  the  other  12  Ss  reproduced  the 
0.5  Hs  aoTeaeats.  All  of  the  sowsaeat  patterns  were  reproduced  at  each  of  three 
steeriag«-«heel  ria  force  lewels  i.e.  0 I,  T«5  H sad  15  !•  As  in  Szperiaeat  I 
the  relation  between  steering  force  sad  steering-wheel  eagle  was  linear.  Steer- 
ing-wheel eagle  si^litute  end  steering  force  were  used  sgaia  as  the  withia-sub- 
ject  warishles. 


3.2.U  Prooec2ur« 

Ss*  seat  and  handgrip  were  sdousted  as  in  Esperiaent  I.  The  experiaent  took  12 
days  with  the  0.2  Hs  aoweaeats  carried  out  in  the  first  six  days  sad  the  0.5  Hs 
■owsMats  on  the  last  six  days.  To  Ss  participated  per  day*  fiach  day  was  di Tid- 
ed into  18  blocks.  The  two  Ss  alternatively  perfbraed  a block.  In  a block  the 
seas  aoTeaent  was  presented  and  reproduced  for  UO  consecutive  trials.  Sequence  of 
■oveaent  conditions  was  rsndoaited  over  Ss  for  the  within-s objects  part  of  the 
experiasntal  desigx.  Pursuit  tracking  of  the  aoveaent  pattern  served  as  the 
stimulus  phase  of  each  trial.  The  starting  position  of  both  the  target  line  sad 
Ss*  cursor  were  in  correspondence  with  the  centre  position  of  the  steering  wheel. 
The  starting  aoasnt  of  the  target  aovemnt  could  be  anticipated  with  the  aid 
of  a warning  sigial. 

This  signal  was  a light  spot  that  was  projected  on  the  screen  at  20  ca  to  the 
right  of  the  target  line.  Before  the  start  of  the  target  aoveaent  this  spot 
aoved  to  the  left  (20  ca/sec).  The  target  aoveaent  started  as  soon  as  the  light 
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spot  touched  the  target  line.  After  tracking  the  stiaulus  aDTeMut  Ss  had  to 
close  their  eyes  end  reproduce  the  ■oeewnt  as  accurately  as  possible  without 
the  aid  of  risual  feedback.  After  this  i^esponss  aDweaent  Ss  released  the  steer- 
ing wheel,  then  the  steering  wheel  was  set  in  the  starting  position  again  by 
the  ezperiaenter.  th\is«  Ss  did  not  get  feedback  about  the  terminal  position  of 
the  response  aoTsasnt.  A block  of  Uo  trials  was  carried  out  in  about  15  ain 
and  10  ain  for  the  0.2  Hx  and  0.5  Hz  aoweaents  respectively. 

3.2.5  Data  anatyaxa 

Both  stimulus  and  response  aoveaents  were  recorded  continuously  with  a sai^le 
rate  of  105  seizes  fbr  each  aoveaent.  Means  end  standard  deviations  were  cal- 
culated fbr  Boveaent-eaplitude  errors  to  the  left  to  the  right 

and  at  the  end  of  the  aoveaent  both  for  the  stimulus  and  respcmse  aove- 

aent  (Fig.  3b).  Algebraic  error  between  actual  aoveaent  solitude  and  ideal 
aoveaent  solitude  was  taken  as  error  score.  Timing  accuracy  was  aeasured  by 
determining  the  aovement  time  Tat  for  which  the  start  and  end  of  each  aoveaent 
were  calculated  by  way  of  a least  square  fit,  thereby  constructing  a regression 
line  through  the  eight  data  points  surro\mding  the  point  6g  • (start)  and 
6,  ■ (end)  (see  Fig.  3b).  Timing  accxirac  was  calculated  in  relation  with 
the  same  type  of  movement  time  of  the  * ideal  moment.  Therefore  timing  accu- 
racy is  presented  in  terms  of  percents  too  slow  or  too  fast.  Means  and  stand- 
ard deviations  were  calculated  for  these  percentages  as  well. 

Performance  mCnr  stiaulus  conditions  was  aeasured  by  determining  the  inte- 
grated error  score  during  pursuit  tracking.  An  evaluation  of  these  data  indi- 
cated that  most  of  the  habituating,  learning  and/or  transfer  effects  occurred 
during  the  first  15  trials  of  each  block.  For  that  reason  aeans  and  standard 
deviations  of  aaplitude  and  timing  accuracy  were  calc\ilated  over  the  last  25 
trials  of  each  block.  Differences  in  means  and  standard  deviations  were  again 
tested  on  their  statistical  si^iificance  by  AHOVA. 

3*3  Results 

As  shown  in  Table  I the  priaary  part  of  the  aoveamat  (to  the  left)  has  a re- 
aarkable  overshoot  tendency  (p<0.0l)  A SR  x SA*  interaction  (p<0.05)  points  to 
the  fact  that  the  overshoot  effect  is  leas  pronounced  fbr  the  10^  aoveaant  con- 
ditions. In  the  second  part  of  the  movement  (to  the  right)  the  overshoot  effect 
is  less  (0.2  Hz  condition)  or  even  disappeared  (0.5  Hz  condition).  In  the  latter 
condition  an  uadershoot  effect  can  be  noted  for  the  50^  movement  condition. 
Steering  force  does  not  heavily  influence  the  overshoot /vcdershoot  effect.  Only 
in  the  0.2  Hz  condition  the  steering- force  level  of  15  H tends  to  result  in 
less  overshoot  as  collared  with  the  0 H condition. 

The  standard  deviations  of  the  movement  amplitudes  show  more  or  less  the  same 
effects  for  the  aoveaent  parts  to  the  left  snd  the  right.  Standard  deviations 
are  highly  dependent  on  moveaent  aiplitude  with  the  largest  deviations  fbr  the 
largest  movement  ai^litudes  (see  Fig.  U).  The  F x x SR  interaction  indicates 
that  for  the  0.2  Hz  condition  the  slopes  of  the  S and  R curves  differ  siipufi- 
cantly  (p<0.0l),  whereas  for  the  0.5  Hz  condition  the  S and  R curves  are  rather 
parallel.  The  availability  of  steering  force  leads  to  a decrease  in  ai^litude 
standard  deviations.  For  the  moveaent  to  the  left  this  effect  holds  for  both 
the  stimulus  and  response  aoveaent.  Fbr  the  aoveaent  to  the  right  steering 


*SR  ■ stimulus  response  SF  ■ steering  force 

SA  • steering-wheel  angle  solitude  F « frequency 
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T«bl«  I Kt4&  algebraic  ■oT»MAt--ai^litudt  trror  fbr  th«  wormmnt  conditions 
in  Sxpsriaent  II  (1  “ Isftvnrd,  r • rightward  part  of  tha  aotawntt 
OTarahoot  positifa)* 


r 

9 

I 3 


• 1 


0 


staannq  ahsal  ongla  omplttuda  (dag) 

rig.  U Standard  daviation  of  tha  staaring-vtaaal  angXt  aa^Iituda  for  tha  aova- 
annt  conditions  in  Xxpariaant  XI. 


force  aainly  influancad  the  standard  dariations  of  tha  raaponsa  aoTananta 
(SF  X SF  interaction) * 

Means  and  standard  dariations  of  tha  rcXatira  errors  in  tisdng  are  shown  in 
rig.  5.  Tining  accuracr  under  stiaulus  conditions  is  rather  good.  Both  aora- 
■ant  a^)lituda  and  steering  force  influence  tisdng  aceuraer  in  reproduction. 

In  Boat  conditions  reproduction  tiass  are  too  long*  especially  with  the  30^  and 
50^  as^litudes.  Only  in  the  aK^raaents  vith  the  Icveet  relocity  lerels  (0.2  Hs« 
saall  anplitiides ) and  vith  steering  force  available  the  tendency  to  reproduce 
■DTeaent  tiass  too  long  disappears.  Movaasnt  tiaes  aay  be  too  short  in  these 
conditions.  The  effect  of  steering  force  in  shortening  aoreatnt  tiae  in  repro«> 
duction  is  rather  general  and  influences  all  of  the  aovaasnt  conditions,  the 
relative  error  in  timing  accuracy  in  rteponses  is  soaevnat  larger  under  0.5  Ha 
conditions  as  compared  vith  the  0.2  Ht  condition. 
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stftnng  wh«t4  Qngl*  ompiitvjdt  (dtg) 


Fi^.  5 liiAQS  tnd  atandArd  dayiationa  of  the  relative  erron  in  tioing  for  the 
■oyeaent  conditione  in  Experimt  II. 

Regarding  the  standard  deyiationa  of  the  tiadng  error  the  F x SB  interaction 
(p<0.0O  indicates  that  differences  betveen  stiaulua  and  response  Boyewmta 
are  less  in  the  0*5  Hx  condition  as  coapared  with  the  0.2  Hs  aoyeaent.  This 
effect  is  in  correspondence  vith  the  effect  that  vaa  noted  for  the  standard 
deyiations  of  the  aoyesient  aaplitude. 

3.^  Discui^ion 

The  purpose  of  Experiaent  II  vas  to  investigate  the  efficiency  of  the  N to  a 
transformation  in  a continuous  taah  and  to  measure  the  effects  of  moyeamnt 
amplitude,  frev^uency  and  steering  force  on  reproduction  performance  in  this 
type  of  task. 

Means  and  standard  deviations  for  the  criterion  or  stimulus  movements  may  be 
considered  aa  a maadmum  of  Sa'  accuracy  in  generating  the  desired  manual  con- 
trol actions  N.  The  results  indicate  that  vith  regard  to  the  amplitude  and 
timing  overshoot /undershoot  tsndency  the  stimulus  mDVssMnts  vere  rather  accu- 
rate.  Amplitude  standard  deviations  for  stimulus  conditions  (Fig.  U)  shov  that 
the  variability  increases  slightly  vith  movement  ssqplitude  snd  frequency.  These 
data  suggest  that  the  variability  in  stimulus  moveoents  is  mainly  dspendent  on 
movement  velocity.  Fig.  6 nay  serve  as  sn  illustration^  and  presents  amplitude 
standard  deviations  (primary  movemant  part)  under  stimulus  conditions  as  a func- 
tion of  8»vemtnt  velocity.  The  maximum  value  of  the  velocity  in  the  primary 
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Pig.  6 StAndard  devi«tioa»  of  the 
ateerixif-vheel  eo^ie  AamXitudt^  ler 
atiaulua  conditions  f the  c'  ^t 
fl»reaent  velocity  conditions 
vere  taken  over  steerinc  fozx  Is. 


part  of  the  eoveaent  is  taken  as  aoveaent  velocity.  The  steering  force  effect 
on  as^Xitude  standard  deviations  indicates  thac  the  variability  of  the  stia* 
ulus  aoveasnts  is  slightly  decreased  vhen  steering  force  is  available. 

Tiaing  standard  deviations  under  stinulus  conditions  (Fig.  5)  sbov  that  the 
variability  in  timing  for  the  0*5  Hs  aoveaent  is  about  tvice  that  of  the  0.2  Hs 
aoveaent,  which  points  to  the  fact  that  tiaing  variability  is  rather  constant 
in  seconds  i.e.  about  150  nsec. 


Behaviour  in  rseponses  aay  be  considered  as  Ss'  accuracy  in  generating  the  ac- 
tual control  actions  a vhen  using  the  M respreaents;tion  as  a reference.  The 
response  data  should  therefore  again  be  considered  ta  an  overall  description 
of  the  H to  a transforaation  and  the  acetiraey  of  M.  Means  of  aaplittide  and 
tiaing  behaviour  under  response  conditions  are  infliienced  by  aoveaent  conditions. 
Fig.  7 gives  asan  relative  ai^litude  and  tiaing  errors  as  a function  of  aoveaent  velocity. 


Fig.  7 Relative  aj^litude  and 
timing  errors  for  the  differ- 
ent aoveMtnt  velocity  condi- 
tions* Means  vere  taken  over 
steering-force  levels. 


Note  in  Fig.  7 that  amplitude  errors  are  presented  as  relative  errors,  i.e.  as 
a percentage  of  the  aoveaent  aapXitude.  Relative  amplitude  errors  were  calcu- 
lated by  taking  the  sum  of  the  algebraic  error  of  the  leftward  and  rightvard 
part  of  the  aoveaent  divided  by  tvice  the  aoveaent  solitude.  Msriaua  velocity 
between  the  leftward  and  rightward  part  of  the  aoveaent  was  taken  as  aoveaent 
velocity. 

Three  areas  can  be  distinguished  in  Fig.  7: 

A With  low  aoveaent  velocity  tiasing  errors  are  saall,  aaplilude  shows  a aajor 
overshoot  effect  and  aoveaent  velocity  is  too  high. 
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B In  the  area  of  ffloderate  noveaent  velocity  both  tiaing  and  a^littuSe  ahov  a 
slight  and  about  equnl  overshoot  effect  vhereby  aoveoent  velocity  is  large* 
ly  correct. 

C Vith  high  Boveaent  velocities  relative  ai^litude  errors  a^  ^aall.  There* 
fore  the  tiaing  overshoot  tendency  in  this  area  indicates  ^nvt  aoveasnt 
velocity  in  responses  vere  too  lov«  i.e.  a velocity  undershoot  tendency. 
Steering  force  reduces  tiaing  overshoot  or  may  even  resilLt  in  tiaiug  under  - 
shoot.  Analyzing  this  effect  leads  to  the  suggestion  that  for  the  lov  velocity 
movement  conditions  steering  force  results  in  a decrease  of  the  positioning 
overshoot  tendency  without  influencing  aoveaent  velocity.  For  rapid  aoveasnt s 
steering  force  mainly  influences  aoveaent  velocity  vitnout  infltiencing  position* 
ing.  As  a result  the  velocity  undershoot  effect  as  noted  under  C is  redveed 
vith  steering  force  available.  This  laxter  effect  may  have  also  played  a role 
for  the  10^  aoveaent  condition  in  Experiment  I. 

A^li*.  fe  standard  deviations  under  response  conditions  (Fig.  k)  show  a remark* 
able  increase  vith  aoveaent  amplitude • For  the  0.2  Hz  aoveaent  condition  the 
difference  betveen  stiaulus  and  response  aovements  can  largely  be  ejqplained  by 
the  positioning  accuracy  data  f^oa  Experiment  I.  This  explanation  does  not  oa* 
pletely  hold  for  the  0.5  Hz  aoveaent  condition.  In  the  latter  condition  the 
variability  under  stiaulus  conditions  is  greater  as  compared  vith  the 
0.2  Hz  aoveaent 8.  Nevertheless  the  response  variability  for  the  0.5  Hz 
aoveaents  is  about  the  same  as  for  the  0.2  Hz  aovements.  This  effect  sho^d  be 
considered  in  relation  vith  the  rather  hi(^  accuracy  of  the  means  of  the  ^^.5  Hz 
aoveaent  amplitudes.  Together  these  data  suggest  that  vith  slov  aovements  both 
positioning  and  velocity  (in)accuracy  are  of  iag)ortance,  vbereas  vith  rapid 
movesants  behaviour  is  controlled  by  velocity  arl  timing  accuracy. 

The  main  steering  force  effect  in  redlining  amplitude  variability  holds  for  both 
the  0.2  Hz  and  0.5  Hz  movement  conditions.  data  from  Experiment  I illustrat* 
ed  the  functioning  of  steering  force  in  reducing  positioning  variability.  Ex- 
periment II  indicated  that  steering  force  aay  also  influence  movesant  velocity. 
Therefore,  the  steering*force  effect  on  amplitude  variability  may  be  a result 
of  a reduction  in  both  positioning  and  velocity  variability  for  slov  movements. 
Vith  rapid  aovements  steering  force  probably  aainly  reduces  velocity  variability. 

In  susnazy  it  can  be  stated  that  the  combined  results  of  Experiment  II  shov 
that  at  the  lover  move,  t velocities  the  positioning  accuracy  of  continuous 
aovements  under  time  constraint  is  verse  vhen  coiq>ared  vith  that  of  discrete 
aovements  vithout  time  constraints.  The  additional  role  of  velocity  overshoot 
vas  illustrated.  For  rapid  aoveaents  a velocity  undarshcot  effect  may  occur, 
which  * together  vith  a sli^t  tiaing  overshoot  tendency  - leads  to  the  situ* 
at  ion  that  the  positioning  accuracy  for  rapid  aoveaents  aay  be  better  than 
those  for  slov  movements. 

Moveaent  velocity  proved  to  be  a major  factor  which  largely  deterai.  es  the 
relative  importance  of  positioning,  velocity  and  tiaing  accuracy.  The  role  of 
steering  force  can  be  divided  in  three  parts.  Firstly,  steering  force  decreases 
positioning  overshoot  effects  of  lov  velocity  movements.  Secondly,  steering 
force  reduces  the  velocity  undershoot  effect  of  rapid  aoveaents  end  finally 
steering  force  reduces  positioning  variability. 

As  mentioned  in  the  introauction  .he  relevancy  of  the  present  daca  will  be 
tested  further  in  an  experiment  on  precognitive  and  pursuit  track*^Qg*  In  this 
latter  experiment  tracking  of  predictable  and  unpredictable  inputs  will  t? 
analyzed  under  conditions  vith  and  without  occlusion.  Thus  the  role  of  the 
internal  ix-presentations  IMV  and  MRS  as  functioning  in  combination  vith  the 
proprioceptive  system  aay  be  evaluated  in  more  detail. 
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AftSTUCT 
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TM  conAA^uARCAA  of  CM  Ability  to  control  joint  iapAgAnc#  nr#  41acuaaa4. 
lAAod  on  cb#  Ability  to  control  inpA4AncA  An  onplAnACion  of  tM  cruciAl 
col#  plAyo4  by  tuo-joint  wacIaa  in  tb#  control  of  oACurnl  novownt  in  pro- 
Poaa4.  lb#  inplicAtionA  uith  roApAcC  to  tb#  control  of  aAnipulAtora  no4 
tM  aMoling  of  tb#  buana  oporntor  nro  4iACUAAA4. 
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UntOOUCTION 

Th«  %iork  presented  in  this  peper  is  pert  of  sn  ontoinf  project  vhose  object 
is  to  control  excemelly  poi#ercd  assistive  devices  such  ss  prosthesea  end  orthos** 
es  using  bioelectric  signals  such  as  the  electrical  activity  of  wtscle*  Substan** 
tial  progress  has  been  made  on  the  signal  acquisition  problem,^  and  the  major 
focus  of  present  efforts  on  this  project  is  i^e  correct  interpretation  of  the 
acquired  signals.  Our  objective  is  to  deteraine  fron  the  available  bioelectric 
signals  %ifaat  the  operator *s  aotor  intent  is  and  to  deduce  '.iiat  the  natural  limb 
mould  have  done  in  response*  then  gecet*ate  the  appropriate  cooMod  signals  so 
that  the  assistive  device  mill  do  vhat  the  natural  liab  mould  have  done.  Our 
work  has  yielded  new  insights  into  the  control  of  movement*  some  of  which  are 
presented  in  this  paper* 

TUVIKG  IMPEDAKCE  ST  AHtaCOtflST  OO-ACTIVAnOtf 

Correct  interpretation  of  bioelectric  signels  ia  derived  from  e knowledge 
of  wuaclc  mechanics  and  functional  anatomy.  In  addition  to  generating  the  forces 
which  cause  movement*  muscles  behave  es  tunable  springs.  If  the  length  of  a 
muscle  is  fixed*  the  isometric  contractile  force  increesea  es  s function  of  the 
activetion  level  of  muscle.  However*  if  the  length  of  the  muacle  is  ellowed  to 
change*  the  stiffness  of  the  muscle  (or  more  generally  * its  mechenical  impedance) 
also  increases  with  increasing  muscle  ectivation(243)  • Anetomicelly*  muscles 
ere  arranged  about  Che  joints  in  antagonist  or  opposing  pairs.  A pussling 
aspect  of  muscular  coordination  ia  chat  under  many  circumstances  antagonist 
wuscles  are  active  simultaneoualy*  Because  co-*ectivetion  coats  input  chemical 
energy  but  does  not  contribute  to  the  mechenical  work  output  of  the  limb*  it 
represents  an  energy  diseconomy.  Under  the  reesoneble  assumption  that  the  major- 
ity of  movements  are  tailored  sc  es  to  minimise  energy  coeo  while  accomplishing 
the  task  objectives*  the  purpose  of  co-ectivetion  needs  to  be  explained.  As 
shown  in  Figure  1 co-actxvation  of  antagonist  muscles  permits  independent  cont- 
rol of  the  torque  about  a joint  and  the  totetional  stiffness  or  ia^edance  about 
the  joint.  Thus  the  co-activation  of  antagonist  muscles  provides  an  important 
v^icle  for  adaptive  tuning  of  the  system  perameters  which  is  independent  of 
feedback*  that  is*  open-loop. 

Polit  end  Bissit^^hsve  shown  that  deaffarented  monkeys  can  perform  rerget- 
*^acqv  ition  movemets  in  the  presence  of  external  mechenical  disturbances  and 
in  the  absence  of  any  afferent  feedback.  This  is  possible  because  e given  level 
of  co-setivetion  of  entegooist  muscles  defines  an  equilibrium  condition  for  the 
joint.  Displacement  of  the  limb  from  this  equilibrium  position  results  in  the 
generation  of  e restoring  torque  which  is  s function  of  the  mechenical  proper- 
ties of  tie  muscle  and  is  independent  of  efferent  feedback.  Furthermore*  if 
the  activities  of  the  antagonist  muscles  are  increased  simultaneously*  the 
equilibrium  condition  of  the  joint  can  remain  unchanged  while  the  stiffness 
shout  that  equilibrium  condition  is  increased  (See  Figure  I). 

KIKMAnCALLT  COMSTBAIBH)  MOVEMEnS 

The  eeility  to  tune  the  mechenical  Impedance  of  the  joints  can  simplify 
movements  made  against  external  kinamatic  conatrsiaca.  For  example  consider 
the  problem  of  turning  e crank  handle  or  opening  e door:  If  toe  stiffnesses 

about  the  joints  ere  high*  ss  is  the  case  in  most  manipulators*  the  end  point 
of  the  manipulator  must  be  moved  in  the  required  circular  arc  vith  high  posi- 
tional accuracy  or  high  interface  forces  will  result.  This  is  difficult  be- 
cause it  requires  accurate  knowledge  of  tUe  location  of  the  binge  end  of  the 
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Assume  linear  force-length  relation:  F • u k (L  - L^)  ; aF/3L  • u k 

(F:  force;  L:  length;  L^:  rest  length;  u:  neural  input;  k:  constant) 


Scale  variables  such  that:  Tj^  • Ujj(l  - Kd)  ; • u^(l  ♦ K6) 

0<Ujj<l;  0<u^<l;  Tj^>0;-T^>0;for  -s/2  < 0 < i/2 
(T;  torque:  K:  constant;  C:  Joint  angle) 


Fiore  1: 


The  net  torque,  T^,  is  the  difference 
between  the  agonist  and  antagonist  torques. 

^ ’ “t^  ■ ^“b  * “t^'^® 

torque  stiffness 
control  control 

If  external  torque  is  lero,  ■ 0 a*, 
equilibrium.  Thus: 

e - • »t>  . 

(«b  ♦ {U^/U^  ♦ 1)K 

if  f 0 

CONTROL  OF  JOINT  STIFFNESS  BY 
ANTAGONIST  CO-ACTIVATION 
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the  perpendicular  distance  between  the  hinge  and  the  handle,  in  addition  to 
the  ability  to  control  the  position  of  the  end  point  accurately*  In  contrast 
if  the  stiffnesses  about  the  joints  are  low,  as  is  the  case  in  the  natural 
linb,  the  end  effector  need  only  exert  a fores  in  the  general  direction  of 
the  aovement,  allowing  the  kinewatic  constraint  to  determine  the  details  of 
the  end  point  trajectory*  However,  a targe  t-acquis  it  ion  novesmnt  such  as  that 
required  to  grasp  the  handle  will  require  high  positional  accuracy  and  this  in 
turn  may  dictate  hi^  stiffnesses  about  the  joints.  The  ability  to  tune  the 
stiffnesses  about  the  joints  permits  the  manipulator  to  operate  successfully 
under  both  conditicus. 

Successful  manipulation  against  kinematic  constraints  requires  not  only 
that  Che  Lapedance  about  the  manipulator  joints  be  tunable  but  tbnc  imped* 
ancr  of  the  end  effector  be  controllable.  That  is,  manipulation  will  be  sim* 
plified  if  it  is  possible  to  specify  the  movement  of  the  end  efic;:  iu  res* 

,^nsv  CO  arbitrary  disturbance  forces.  Consider  the  problem  of  inserting  a 
pe£  into  a hole:  0nder  the  action  of  the  lateral  forces  resulting  from  the 

misalignment  of  the  peg  with  respect  to  die  hole  the  end  effector  must  move 
in  a direction  so  as  to  reduce  these  forces.  Under  the  action  of  the  torques 
wbidi  could  cause  wedging  and  jamming  the  end  effector  must  rotate  so  as  to 
reduce  these  torques.  However,  disturbance  forces  in  the  direction  of  inser* 
tion  of  the  peg  into  the  hole  must  be  overcome.  Thus  we  have  specified  the 
desired  values  of  the  elements  of  the  stiffness  matrix  or  tensor  which  relates 
the  applied  forces  and  torques  to  the  resulting  positional  and  angular  movements . 
It  has  been  shown  that  provision  of  appropriate  stiffness  or  compliance  in 
an  industrial  manipulator  considerably  simplifies  tasks  involving  manipulation 
of  objects  againt  kinematic  constraints  su^  as,  for  example,  the  insertion  of 
a shaft  into  a bearing. 

END  EFFECTOR  STIFFNESS  CONTROL 

The  question  now  is:  If  the  stiffness  about  each  joint  (or  along  each 

degree  of  freedom)  can  be  dictated,  can  the  stiffness  tensor  which  determines 
the  pKition  of  the  end  effector  in  response  to  arbitrary  force  inputs  be  spec* 
if led?  To  address  this  question  we  consider  the  movements  of  a planar,  two* 
degree*of*freedom,  r sites ian*coordinate  manipulator  as  thown  in  Figure  2. 

The  actuators  which  produce  the  movements  of  the  cursor  are  depicted  as  springs. 
The  stiffness  tensor  for  the  cursor  is  most  easily  investigated  by  finding  the 
potential  energy  stored  iu  the  spring  as  a function  of  the  deviation  of  the 
cursor  from  its  equilibrium  position  which  is  assumed  to  be  at  the  origin  of 
the  coordinate  system.  If  we  let  the  stiffness  of  the  horizontal  springs  of 
the  manipulator  shown  in  Figure  2 become  very  large  while  the  stiffness  of  the 
vertical  springs  becomes  very  small  then  the  potential  energy  function  is  a 
very  long,  narrow  "valley**  oriented  along  the  vertical  axis.  Conversely,  if 
the  vertical  springs  become  sifinitely  stiff  while  the  horizontal  springs  become 
infinitely  compliant  the  potential  energy  function  becomes  a long,  narrow  "val* 
ley**  oriented  along  the  horizontal  axis.  If  the  vertical  and  horizontal  stiff* 
nesses  are  finite  and  equal,  the  energy  function  becomes  a bowl*sbaped  depres* 
sion  with  its  lowest  point  at  the  equilibrium  position,  for  a given  set  of 
spring  stiffnesses  the  contours  of  constant  potential  energy  are  ellipses.  The 
orientation  of  che  potential  energy  **valley**  is  given  by  the  principal  eigenvec* 
tor  of  the  stiffness  tensor  and  the  width,  or  aspect  ratio,  of  the  potential 
energy  **valley**  is  given  by  the  ratio  of  eigenvalues  of  the  stiffness  tensor. 

If  the  stiffness  tensor  could  be  completely  specified  then  the  **valley"  of 
the  potential  energy  function  could  be  pointed  in  any  direction  and  could  be 
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"Direction  of  freedon" 
for  coupling  springs 


Principe!  eigenvector  can  point 
in  any  of  these  directions,  hut 
unless  it  coincides  with  one  of 
the  "directions  of  freedom"  the 
aspect  ratio  Is  restricted. 


Principal  eigenvector  cannot 
point  in  these  directions. 


. "cli* 
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FIGURE  3.  PLANAR  MANIPULATOR  WITH 
COUPLING  SPRINGS 
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any  dasirad  vldtK*  This  cannot  ba  achiavad  with  tUw  tyttam  aho%m  in 
Flfura  2*  Tha  principal  aiganvactor  of  tha  atlffnass  tansor  can  only  ba 
pointad  along  ona  or  tha  othar  of  tha  coordinata  axas*  Hovavar*  if  va  add  tha 
pair  of  coupling  springs  shown  in  Figura  3 tha  situation  changas*  If  tha 
atiffnass  of  thasa  springs  is  aada  larga  whila  tha  stiffnassas  of  othar  springs 
ara  allowad  to  approach  zaro  than  tha  cursor  will  ba  fraa  to  Mva  only  along 
tha  diagonal  shown.  This  is  tha  *'diraction  of  fraadom'*  associatad  with  this 
pair  of  springs.  Tha  **diractions  of  fraadon'*  associatad  with  tha  horizontal 
and  vartical  springs  ara  tha  vartical  and  horizontal  axes  raspactivaly.  It 
is  clear  that  tha  principal  aiganvactor  of  tha  stiffness  tansor  for  tha 
cursor  can  now  ba  oriantad  along  this  diagonal  diraction  of  fraadoa.  Furthar^ 
■ora,  tha  width  of  tha  potantia!  anargy  "vallay'*  can  ba  spacifiad  at  will.  In 
addition,  it  can  raadily  ba  showi  that  tha  principal  aiganvactor  of  tha  stiff* 
tansor  can  ba  oriantad  alon.i  any  of  tha  diractlons  shown  in  Figura  3 bat* 
waan  tha  directions  of  fraadon.  Howavar,  if  tha  principal  aiganvactor  doas 
not  coincide  with  one  of  tha  three  directions  of  fraadon  than  tha  ratio  of 
aiganvaluas  of  tha  stiffness  tansor  is  constrained  such  that  a lower  Unit  is 
placed  on  tha  width  of  tha  potential  anargy  valley;  that  is,  tha  vallay  cannot 
be  nada  infinitely  narrow.  In  general  it  can  ba  shown  that  if  tha  angle  between 
two  directions  of  fraadon  is  lass  that  90  degrees  than  tha  principal  aiganvactor 
of  tha  stiffness  tensor  can  ba  oriantad  along  any  diraction  batwaan  thasa  two 
directions  of  freedom.  Tha  more  acuta  tha  angle  batwaan  tha  directions  of 
fraadon  tha  narrower  tha  potential  anargy  function  vallay  can  ba  made  whan  tha 
principal  aiganvactor  of  stiffness  tansor  is  otiantad  aidway  batwaan  tha  two 
directions  of  fraadoa. 

IbOLE  OF  TV0*J0INT  MUSCLES 

Tha  analogy  batwaan  tha  **manipulator**  of  Figura  2 and  3 and  tha  nusculo* 
skeletal  system  is  direct:  Tha  presence  of  tha  two* joint  auscles  aaans  that 

tha  principal  aiganvactor  of  tha  stiffness  tansor  of  tha  and  effector  can  ba 
oriantad  in  almost  all  directions*  This  cannot  ba  achiavad  using  tha  single* 
Joint  ousclas  alone.  If  wa  consider  motions  of  tha  upper  limb  in  a horizontal 
plana  and  modal  the  upper  limb  as  a tvo*Iink  kinematic  chain  than  va  can  define 
directions  of  freedom  as  in  tha  case  of  tha  cartas ian*coordinata  manipulator* 

If  tha  singla*joint  albo'  muscles  la.g*  brachialis,  medial  and  lateral  heads  of 
triceps,  etc.)  ara  made  infinitely  stiff  whila  all  othar  ousclas  are  made 
infinitely  compliant  tha  diraction  of  freedom  is  a circular  arc  cantered  about 
tha  shoulder  axis  (Sea  Figura  4a).  If  the  singla*joint  shoulder  muscles 
(a.g.  anterior  and  posterior  deltoid,  etc.)  ara  made  infinitely  stiff  whila 
all  othar  muscles  ara  made  infinitely  compliant  tha  diraction  of  freedom  is  a 
circular  arc  cantered  about  tha  elbow  axis  (Sea  figura  4a).  Tha  diraction  of 
freedom  associatad  with  tha  two* joint  musclas  (a.g*  biceps,  long  head  of  tri* 
caps)  will  ba  a function  of  tha  precise  anatomical  connections  of  tha  muscles 
to  tha  limbs*  For  simplicity  wa  make  tha  quantitatively  inaccurate  but  qusli* 
tativaly  correct  assumption  that  tha  two*joint  muscles  act  with  fixed  and  equal 
moment  arms  about  tha  shoulder  and  elbow  joint.  Under  thasa  assumptions,  if 
tha  two-joint  muscles  arc  made  infinitely  stiff  while  tha  singla*joint  muscles 
are  infinitely  compli  \t  than  s kinematic  constraint  has  bean  imposed  upon  tha 
values  of  tha  shoulder  and  elbow  angles  such  that  tha  absolute  angle  of  tha 
forearm  with  respect  to  tha  thorax  is  fixed*  As  a result  tha  and  effector 
describes  a ciruclar  arc  as  shown  in  Figura  4b.  This  is  tha  diraction  of 
freedom  associated  with  tha  two-joint  muscles.  If  va  look  at  tha  affect  of 
tha  single  and  doubla*joint  muscles  taken  together  va  can  sea  that  for  a 
wide  range  of  positions  in  tha  movement  space  tha  directions  of  freedom 
intersect  ona  another  at  acuta  angles  such  that  tha  principal  eigenvector 
of  tha  stiffness  tansor  of  the  and  effector  can  ba  oriantad  along  any  dirtc* 
wion  (Sea  Figure  4c).  This  is  not  possible  with  tha  singla*joint  muscles  alone. 
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Assume  movement  in  « horizontel  pUne. 
foreerm  end  hand  rigid,  elbow  end  shoulder 
to  be  simple  pivots,  ell  muscles  to  have 
constant  moment  arms. 


c:  directions 
of 

freedom 
for  1- 
and 

2-Joint 

muscles 


FIGURE  "DIRECTIONS  OF  FREEDOM"  FOR  THE  UPPER  LIMB 
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FIHAL  POSITION  CONTROL 

On*  of  th«  fAscinating  cons«quARC«t  of  the  sprlnglika  proporties  of 
amsclo  i%  that  in  the  case  of  aotion  about  a single  joint  the  entire  aoveMRt 
could  be  controlled  sinply  by  specifying  the  final  equilibriuia  position^^). 

The  biocontroller  would  aerely  specify  the  appropriate  set  of  suscle  activi- 
ties required  to  define  the  equilibrium  position  of  the  joint  and  allow  the 
inherent  mechanical  properties  of  the  musculo-skeletal  system  to  take  care  of 
the  details  of  the  movement*  It  is  not  suggested  that  this  is  the  only  or 
even  the  predominant  mode  of  natural  movement,  but  it  could  be  significantly 
advantageous  to  the  central  nervous  system  as  the  biocontroller  need  only 
intervene  in  the  control  of  movement  once  every  several  hundred  milliseconds 
or  so  thus  allowing  the  higher  levels  of  the  central  nervous  s^mtem  to  be 
foewrad  on  other  tasks*  The  question  now  arises:  Could  a similar  control 

scheme  work  for  multiple-degree-of-freedom  movements?  It  is  easy  to  show  that 
if  only  single-joint  muscles  are  used  then  for  a large  number  of  reasonable 
combinations  of  start  positions  and  target  (final)  postions  it  is  not  possible 
to  achieve  the  al3x>st-straight**line  trajectory  between  start  and  target  which 
is  typically  observed  for  unconstrained  movements.  For  example,  if  the  start 
position  and  target  position  lie  on  an  arc  such  that  in  both  the  start  and 
target  positions  the  angle  of  the  upper  arm  is  identical,  only  the  angle  of 
the  forearm  being  different,  rhen  if  the  muscles  are  activated  such  that  the 
equilibrium  condition  for  the  limb  is  at  the  target  position  the  shoulder 
muscles  can  generate  no  torque  about  the  shoulder  joint  when  the  limb  is  at  rest 
in  the  start  position*  Thus  the  net  force  vector  at  the  end  effector  due  to 
the  springlike  properties  of  the  imisculo-skeletal  system  must  point  in  a direc- 
tion such  that  it  inte.  cts  the  shoulder  joint  (See  Figure  5a).  This  %rill  re- 
sult in  a movement  which  swings  wide  of  the  typically  observed  path  between 
the  start  and  targC  positions*  However,  the  addition  of  the  two-joint  muscles 
considerably  changes  matters:  For  the  combination  of  start  and  target  positions 

described  above  the  two-joint  muscles  provide  the  necessary  freedom  to  allow 
the  force  vector  at  the  end  effector  to  point  directly  at  the  target  position 
(See  Figure  3b).  Furthermore,  the  potential  energy  function  for  deviations 
about  the  equilibrium  (target)  position  can  be  set  up  such  that  the  energy 
function  is  a narrow  "valley''  running  from  the  equilibrium  position  to  the 
start  position.  This  would  mean  that  the  end  effector  would  tend  to  follow 
the  "valley  bottom"  and  move  along  an  approximately  straight  line  trajectory* 
\gain,  this  opens  up  the  intriguing  possibility  that  large  portions  of  the 
time  history  of  the  motion  of  the  end  effector  could  be  controlled  by  the 
inherent  properties  of  the  musculo-skeletal  system  with  only  minimal  interven- 
tion from  the  higher  levels  of  the  central  nervous  system. 

RELEVANCE  TO  KANIPULATOR  CONTROL  AND  HOHAN  OPERATOR  MODELING 

From  the  foregoing  analysis  it  follows  that  if  the  stiffness  or  impedance 
tensor  for  the  end  effector  of  any  manipulator  is  to  be  fully  controllable  then 
it  will  be  necessary  to  provide  adaptable  coupling  between  two  or  more  degrees 
of  freedom  of  the  manipulator.  This  coupling  may  be  provided  mechanically,  as 
in  the  natural  limb,  or  electronically  via  feedback.  Either  way,  the  coupling 
should  provide  an  adaptable  kinematic  constraint  similar  to  that  imposed  by 
the  sailti-joint  muscles  in  the  natural  limb*  As  mentioned  earlier,  controlling 
the  end  effector  impedance  will  considerably  simplify  manipulation  against 
external  kinematic  constraints*  Another  perspective  is  that  impedance  provides 
a convenient  and  natvual  "language"  for  the  communication  of  motor  intent  between 
the  controller  and  the  effector  (i.e*  the  manipulator).  Two  common  modes  of 
manipulator  control  arc  position  control  and  "force"  control.  The  former,  in 
which  the  desired  position  or  trajectory  of  the  manipulator  is  specified,  works 
well  for  free  manipulstions,  the  movements  being  relatively  insensitive  to  ex- 
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Target 


Assume  the  muscle  activities  are  set  up 
such  that  at  equIUbrljm  the  end  effector 
Is  In  the  target  position. 


a:  If  only  the  l-jo1nt  muscles  are  used 
the  net  force  vector  at  the  end  effector 
when  It  Is  In  the  start  position  must 
point  as  shown. 


Net  force 
vector  may 
point  In 
any  of 
these 
directions 


Contour  of 
constant 
potential 
energy 

"valley 

bottom" 


possible 

trajectory 


b:  If  1*  and  2«Jo1nt  muscles  are  used 
the  net  forte  vector  may  point  directly 
at  the  target,  or  In  any  of  the 
directions  shown. 


c:  If  the  potential  energy  function  Is 

set  up  appropriately  then  the  end 
effector  may  tend  to  follow  the 
approximately  straight  trajectory 
shown. 


FIGURE  5.  TWO- JOINT  PINAL  POSITION  CONTROL 
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C«rnal  disturbances,  but  causes  difficulty  when  dealing  with  external 
kineisatic  constraints.  The  latter,  in  which  forces  or  torques  are  comanded, 
is  better  suited  to  aanipulation  against  constraints,  but  does  not  perform  well 
on  free  laovements.  In  the  former  the  movement  "primitives'*  are  positions;  in 
the  latter  they  er#  forces  or  torques.  However,  the  foregoing  analysis  indicates 
tnat  the  '’directions  of  freedom"  associated  with  each  of  the  manipulator  actuators 
should  be  regarded  as  the  movement  "primitives".  In  other  words,  the  "controlled 
variable"  should  not  be  pusition  nor  force,  but  impedance  (or  stiffness). 

Looked  at  from  the  point  of  view  of  impedance  control,  position  control  and 
force  control  are  simply  degenerate  or  extreme  cases  of  impedance  control.  That 
is,  position  control  implies  very  high  stiffnesses  or  impedances,  while  force 
control  implies  very  low  (zero)  stiffnesses  or  impedances.  A manipulator  with 
controllable  impedance  should  have  far  greater  capabilities  than  either  a forces 
controlled  or  a posit ion^controlled  manipulator  and  shouIC  be  equally  successful 
at  constrained  manipulation  and  free  movement. 

The  human  ability  to  control  impedance  must  be  included  in  oiodels  of  the 
human  operator.  Essentially  the  human  operator  is  capable  of  adjusting  his 
own  mechanical  system  parameters  to  optimise  performance  on  a task.  This  will 
be  most  evident  in  manipulation  of  tools  or  machine  controls.  For  example, 
high  levels  of  co-activation  may  yield  good  positional  control  over  a tool  or 
joystick  due  to  increased  mechanical  coupling  (good  "grip"),  but  the  same 
mechanical  coupling  implies  increased  transmission  of  vibration  and  shock  loads. 

In  a vibratory  environment  the  skilled  operator  may  tune  his  mechanical 
impedance  to  find  the  optimum  trade  off  between  these  effects. 

(k>-acuivation  costs  input  chemical  energy  to  the  muscles  without  yielding 
output  mechanical  work  and  undue  co-activation  will  lead  to  early  fatigue.  An 
unskilled  operator,  being  unable  to  predict  any  external  disturbances,  may 
co-activate  excessively  to  reaucc  their  effects  on  his  movemetns*  A skilled 
operator,  more  familiar  with  the  nature  of  external  disturbances,  may  elect 
for  lower  levels  of  co-activation  and  as  a result  avoid  fatigue.  However, 
even  the  skilled  operator  might  opt  for  high  co-activation  in  less  familiar 
circumstances  such  as  emergencies.  Thus  co-activation  of  antagonists  may  prove 
useful  as  a measure  of  moveoMint  skill  and  mental  workload. 
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A COMPARISON  OF  CONTROL  MOOES  FOR  TIHE-OELAYEP 
REMOTE  MANIPUUTION 

GREGORY  P STARR 


i.  INTRODUCTION 

Transalsslon  tine  delay  In  the  c a— unication  channel  of  a nanual  control 
systen  degrades  perfomance  by  preventing  the  hunan  operator  fron  Innedlately 
seeing  the  results  of  his  actions. 

A tine  delay  can  exist  In  renote  nanipulatlon  systeas. ^caused  by  long 
connunlcatlon  distances  or  bandwidth  llnitatlons.  Ferrell  [1]  conducted  the 
first  research  In  tine-delayed  nanipulatlon  using  a two  degree-of-freedon 
nanlpulator.  His  subjects,  working  at  tine  delays  of  l.C.  2.1,  and  3.2  s. 
could  acco^>11sh  tasks  even  requiring  great  accuracy.  The  subjects  spontane- 
ously adopted  a pattern  of  noving  cautiously,  then  waiting  to  see  the  results 
of  their  actions.  In  experinents  with  a six  degree-of-freedon  naster-slsve 
nanlpulator  systen  and  tine  delays  of  1.0  to  6 s.  Black  [2]  saw  that  subjects 
tried  to  use  the  nove-and-walt  strategy;  but  there  were  often  difficulties. 
The  subjects  seened  to  have  a problen  In  holding  the  naster  am  stationary 
while  waiting  for  feedback.  Any  unoesired  drifting  of  tiie  naster  am  intro- 
duced a discrepancy  between  the  positions  of  the  naster  and  slave.  This 
discrepancy  was  not  perceived  because  of  the  tine  delay.  The  subject  would 
then  begin  his  next  nove  with  an  Inherent  error. 

The  difficulty  of  effectively  using  the  nove-and-walt  strategy  with  a 
naster-slave  manipulator  suggested  that  rate  control  night  be  a more  effec- 
tive control  node  with  tine  delay.  Manipulator  rate  controllers  are  usually 
nultlaxis  joysticks  or  switchboxes  and  are  Invariably  constructed  so  that 
when  the  <'*'erator  wisnes  to  hold  the  nanlpulator  stationary,  he  can  s1^>1y 
renove  his  hand  fron  the  controller.  This  eliminates  the  possibility  of 
undesired  nanlpulator  motion  and  should  aid  the  operator  In  using  the  nove- 
and-walt  strategy. 

The  research  sumarized  in  this  paper  was  conducted  to  conpare  naster- 
slave  and  rate  control  of  a manipulator.  Four  tine  delays  were  used.  These 
delays  (0.0,  0.33,  i.O,  and  3.0  s)  allowed  us  to  examine  the  effect  of  tiae 
delay  on  control -mode  perfomance.  A peg  transfer  task  was  used,  with  auto- 
mated data  acquisition. 

II.  CONTROL-MODE  IMPLO^NTATION 

The  NASA-Aaes  nanlpulator,  designed  by  Vykukal  tt  at.  [3],  was  used  In 
all  experiments.  This  manipulator  consists  of  conical  fiberglass  sections 
connecteo  / rotational  joints  The  motion  of  these  joints  resembles  the 
twisting  of  nested  sections  of  stovepipe.  There  are  seven  rotational  joints, 
plus  the  parallel -jaw  end  effector. 

The  master  am  used  with  this  manipulator  Is  geometrically  similar  to 
the  slave,  although  slightly  scaled  down.  The  operator's  arm  Is  Inserted 
Into  the  master  am,  and  analog  position  servos  control  the  slave  position. 

The  master  had  several  undesirable  characteristics.  Foremost  was 
preference  for  motion  in  certain  directions,  caused  by  the  static  and  viscous 
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Joint  friction  conblnod  with  th*  Msttr's  umisuil  gtoaotry.  In  addition, 
the  operator  could  not  nove  the  naster  through  Its  full  range  of  aotlon. 

Due  to  the  peculiar  geouetry  of  the  ana.  It  ues  necessary  to  use 
resolved  notion  rate  control  (MRC).  conceived  liy  Whitney  [4].  In  mRC, 
a digital  conputer  coordinates  the  Individual  Joint  rates.  The  operator 
specifies  direction  and  speed  of  the  hand  without  concerning  hinself  with 
the  Individual  Joint  rates. 

A si*  degree-of-freedon  Isonetrlc  Joystick  was  used  as  the  rate  con- 
troller. Using  this  Joystick,  the  operator  could  connnd  hand  translational 
and  angular  velocity  along  axes  of  a Cartesian  coordinate  systen  fixed  In 
the  hand  Itself.  See  Figure  1.  For  a conplete  description  of  this  rate 
control  Inpleaentatlon,  see  Starr  [5]. 


Lift 


The  Joystick  had  a saall  but  noticeable  aaount  of  crosstalk,  naklng  It 
difficult  to  cause  aotlon  In  only  one  direction.  To  peralt  aotlon  along  only 
one  axis,  an  operator-activated  switch  was  provided  which  selected  only  the 
largest  output  signal. 


III.  THE  EXPERIMENT 


Task 

A peg  transfer  task  was  used  to  coapare  the  two  control  nodes.  The 
operator  extracted  the  peg  fron  the  left-hand  receptacle,  placed  It  *n  the 
right-hand  one,  reaovad  It  fron  the  right  and  replaced  It  back  In  the  left 
one.  The  subject  was  required  to  fully  Insert  the  peg  before  releasing  It. 

The  receptacles  were  placed  8 In  (20  ca)  apart,  and  both  were  nounted  on 
a table  which  was  tilted  back  towards  the  nenlpulator  at  an  angle  of  32*  with 
the  horizontal.  Furthemore,  tN  right-hand  receptacle  was  tilted  away  fron 
the  left  at  an  angle  of  17*,  thus  requiring  a reorientation  of  the  peg  before 
Insertion. 

Three  pegs  were  used  with  this  task.  All  were  4-1n  (10.2  ca)  long,  and 
were  0.7S-,  0.90-,  and  0.99-1n  diaaeter  (19. 1-,  22.9-,  and  2S.1-aai).  The 
clearance  between  the  pegs  and  the  1-1n  (2S.4-aai)  hole  was  0.2S,  0.10,  and 
0.01  In  (6. 35,  2.54,  and  0.25  Ha),  respectively. 
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The  division  of  • task  Into  simpler  subtasks  has  been  shown  to  be  useful 
In  Industrial  en^lneerlnq  research.  Sudi  a division  of  ccapletlon  tiae  was 
attenpted  by  Blackaer  C6J  In  a peg  transfer  aanlpuUc^on  task.  The  tiae  d1v1> 
slon  was  done  by  the  subj«c*  using  a foot  switch,  and  Blackaer  acknowledged 
that  the  results  were  not  precise  enough  to  permit  any  conclusions. 

The  overall  completion  tiae  In  the  p»^  trinsfer-  task  described  here, 
from  peg  liftoff  to  touchdown,  was  divided  into  three  separate  completion 
times,  each  representing  a subtask.  These  sUk'.nsks  were  witidrawal.  trans- 
port. and  adjustment/ insertion,  defined  as  folnws. 

tuxkdiuam/  began  at  peg  liftoff  and  ended  when  the  peg  left  the  receptacle. 

Ttowapoat  began  when  the  peg  left  the  receptacle  and  ended  when  the  peg 
was  2 ca  from  the  edge  of  the  target  hole. 

Ad}uAtm$it/i>utfUiom.  began  when  the  peg  was  2 ca  fror  the  edge  of  the 
hole  and  ended  at  touchdown  of  the  peg. 

The  state  of  the  task  was  monitored  by  a coigputer  which  accumulated  toe 
subtask  completion  times  and  recorded  them  on  magnetic  tape.  These  times 
were  accurate  to  within  1/30  s. 

The  withdrawal  time  gives  an  Indication  of  effectiveness  In  manipulation 
with  external  contact  forces  where  terminal  accuracy  Is  not  cntclal.  The 
transport  time  represents  effectiveness  In  coarse  positioning.  Finally,  the 
adjustment/insertion  time  reflects  performance  In  two  types  of  motion:  ar 
unconstrained  fine-position  segment  where  terminal  accuracy  is  toe  goal 
(adjustaient).  and  an  rxtemally  constrained  segment  where  force  accomnodatlon 
may  be  necessary. 

Experiment  Design 

A factorial  experlawnt  design  was  used,  the  variables  being  control  mode 
C,  time  delay  T.  peg  size  P,  ana  task  direction  D (left-to-right  or  right-to- 
left).  Because  of  time  constraint  plus  equipment  failures,  we  %iere  able  to 
use  only  one  subject. 

Procedure 

After  learning,  the  subject  performed  2*1  replications  of  the  task  at  each 
combination  of  variables,  for  a total  of  960  replications.  Peg  size  and  time 
delay  were  randomized  within  each  control  mode.  At  the  1.0-  and  3.0-s  time 
delays,  toe  subject  complained  of  fatigue  and  frustration  when  using  master- 
slave  control. 


IV.  ttSULTS  AHO  OISCUSSION 


Withdrawal 

The  withdrawal  times  versus  time  delay  for  each  peg  size  appear  In  Figs. 
2-4,  along  with  least  square  regression  lines.  The  '-ertlcal  lines  through  the 
data  points  are  * one  standard  deviation. 

Comparing  the  regression  lines  at  each  peg  size,  one  can  s.m  toe  degrada- 
tion of  master-slave  control  as  peg  size  Increases.  With  peg  1.  which  had  the 
greatest  clearance,  master-slave  control  resulted  In  lower  withdrawal  times  at 
each  delay.  These  times  were  significantly  different  at  the  I percent  level. 
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with  peg  2,  Mster-sitve  control  ms  superior  at  the  lower  three  delays  (IS 
significance  level),  but  at  the  3.0- : delay,  rate  control  had  a lower  wlth- 
draMl  tine,  althcu^  not  significant.  With  peg  3.  rate  control  had  lower 
wlthdraMl  tines  at  all  delays  with  IS  significance.  The  standard  deviations 
of  the  waster-slave  wlthdraMl  tlwes  with  peg  3 Mre  wore  than  twice  as  large 
as  those  of  rate  control.  Indicating  that  jamlng  way  have  occurred  ..th 
waster-slave  control. 

The  superiority  of  waster-slave  control  In  wlthdraMl  of  pegs  1 and  2 
both  with  and  without  tlwe  delay  can  be  explained  by  considering  the  type  of 
wotlon  necessary.  With  these  pegs  the  clearance  Is  large  enough  so  that  a 
perfectly  axial  wlthdraMl  Is  not  needed  to  avoid  binding.  WlthdraMl  becowes 
a coarse  motion,  emphasizing  speed  rather  than  directional  accuracy.  The 
waster-slave  systew  had  higher  speed  capability  than  the  rate  control  system, 
due  to  the  rate  gain  m used.  Thus  waster-slave  would  be  expected  to  have 
loMr  withdrawal  times  with  pegs  1 and  2.  With  peg  3.  hoMver,  the  wlthdraMl 
changes  character.  The  clearance  of  0.01  In  (0.25  mm)  between  peg  and  hole 
results  In  a wlthdraMl  segment  stressing  directional  accuracy. 

The  angular  clearance,  or  wobble  angle,  shows  the  directional  accuracy 
needed  for  wlthdraMl  better  than  the  radial  clearance.  Wobble  angle  versus 
Insertlsn  depth  for  the  three  pegs  Is  shown  In  Fig.  5.  Peg  3 has  a much 
smaller  wobble  angle  than  pegs  1 and  2,  especially  as  It  nears  bottom. 


7 degrees 

3 degrees 
0.29  deg. 


P«9 

fully 

Inserted 


Fig.  5.  Wobble  angle  versus  insertion  depth 
for  three  pegs. 
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Witn  • tlw  <Jt1«y  ms  present,  the  subjtct  hed  to  aove  open*1oop.  Hk- 
wlthdreml  tiaes  suggest  thet  the  rate  control  systea  had  better  open-loop 
cirectlonal  accuracy*  Hith  rate  control,  the  subject  oriented  the  hand 
parallel  to  the  top  of  the  blxk,  grasped  the  peg,  and  Issued  a pure  "lift” 
comand.  The  hand  would  aove  back  along  the  hole  axis  and  extract  the  peg 
cleanly.  The  operator-controlled  switch  enabling  generation  of  a pure  coa- 
aand  ms  helpful  during  withdraml. 

When  using  mster-slave  control,  the  subject  had  to  aonitor  and  atteapt 
to  null  contact  forces  batman  the  peg  and  the  receptacle.  Active  force 
fee<h>ack  would  have  been  very  helpful,  but  Ferrell  [7]  has  shown  that  active 
force  fOedback  can  cause  Instability  when  a tiae  delay  Is  present. 

Transport 

Fig.  6 shows  transport  tiae  versus  tiae  delay  for  each  peg  size  and 
control  node.  The  regression  lines  are  pooled  over  peg  size.  Transport 
tiae  does  not  appear  to  vary  consistently  with  peg  size  for  either  control 
aode. 


A f-test  aade  on  the  transport  tiaes  pooled  over  peg  size  showed  that 
mster-slave  control  produced  significantly  lomr  transport  tiaes  at  all 
tim  delays.  This  Is  to  be  expected  considering  the  higher  speed  capability 
of  mster-slave  and  the  ligwrtance  of  speed  during  transport. 

Fig.  7 shows  transport  tiae  versus  tim  delay  for  each  control  aode  and 
task  direction.  The  transport  tims  for  mster-slave  control,  direction  2, 
are  far  lomr  at  all  delays  than  for  direction  1,  and  lower  than  rate  control 
In  either  direction. 


Fig.  6.  Transport  tim  versus  Fig.  7.  Transport  tim  versus  tim 

tim  delay,  all  pegs.  delay,  directions  1 and  2. 
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The  most  likely  explanation  for  this  difference  is  the  varying  nechani- 
cal  impedance  of  the  master.  Since  the  master  has  seven  degrees  of  freedom, 
its  joint  rotations  during  direction  2 were  not  necessarily  the  reverse  of 
those  during  direction  1.  Transport  in  direction  1 apparently  involved  more 
joint  rotation  and  did  not  match  one  of  the  master's  1ow>impedance  directions. 
The  nonisotropic  nature  of  this  master-slave  system  is  not  true  of  resolved 
rate  control , which  decoi^iles  the  operator  from  the  geometry  of  the  arm  and 
permits  motion  in  any  direction  with  equal  ease. 

Adjustment/ Insertion 

Figs.  8-1C  show  that  the  adjustment/insertion  times  follow  a pattern 
similar  to  the  wi  :hdrawa1  times,  with  rate  control  degrading  less  with  time 
delay.  The  similarity  is  because  insertion  is  the  reverse  of  withdrawal, 
since  we  required  the  subject  to  guide  the  peg  to  the  bottom  of  the  hole. 


0 0.33  1.0  3.0 

Time  Delay,  Sec. 


Fig.  8.  Adjustment/insertlon  time 
versus  time  delay,  peg  2. 


Fig.  9.  Adjustment/insertlon  time 
versus  time  delay,  peg  3. 


V.  CONCLUSIONS 

Judging  from  these  results,  which  are  certainly  inconclusive  due  to  the 
use  of  only  one  subject,  resolved  motion  rate  control  appears  to  be  more 
effective  than  master-slave  control  for  those  parts  of  a time-deleyed  mani- 
pulation task  emphasizing  accuracy.  Master-slave  control  was  si^erior  to 
rate  control  with  no  time  delay,  but  degraded  more  rapidly  with  delay.  This 
is  partially  due  to  the  ease  of  holding  the  menipulator  stationary  with  rate 
control,  thus  allowing  motionless  pauses  to  receive  feedback.  However,  some 
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Tine  Delay.  Sec. 

Fijj.  10.  Adjustanent/lnsertlon  tine 
versus  tine  delay,  peg  3. 


of  rate  control's  superiority  «ay  be  the  result  of  better  open-loop  position- 
ing accuracy,  which  was  not  directly  neasured. 

Also  significant  was  tiie  difficulty  of  the  task  as  reported  by  the 
subject.  When  performing  with  the  3.0-s  tine  delay,  he  becane  physically 
and  raertally  fatigued  much  nore  quickly  than  with  naster-slave  control. 

These  results  suggest  that  perhaps  confined  naster-slave/rate  control 
would  be  nore  appropriate  for  tine-delayed  nanipulatlon.  Master-slave 
control  would  be  used  for  coarse  positioning,  and  rate  control  for  fine 
positioning. 

We  recognize  that  the  results  of  this  experinent  apply  only  to  the  NASA- 
Anes  nanlpulator  systen.  For  exanple,  a fully  counterbalanced  naster  would 
reduce  the  subject's  physical  workload  and  nay  Increase  open-loop  positioning 
accuracy.  Nevertheless.  It  has  been  shown  that  rate  control  has  advantages 
In  tine-delayed  manipulation. 
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Abstract 


A covputer-controlled  talaoparator  systes  which  is  basad  on  task* 
rafarancad  sansor*aidad  control  has  baan  davalopad  to  study  suparviscry  aani* 
pulation*  This  systast  calla^  SUFBBHAlIt  is  capable  of  parforsiag  coaplicatad 
tasks  in  raal*tiaa  by  utilising  tha  operator  for  high*laval  functions  related 
to  tha  unpredictable  portions  of  a task,  while  tha  subordinate  aachine  par* 
forms  the  more  well*defined  subtasks  under  human  suparvison. 

To  dateraina  whether  supervisory  control  schemes  such  as  these  offer  any 
advantage  over  manual  control  under  real-time  conditionsy  a number  of  experi- 
ments involving  both  simple  and  complicated  tasks  ware  performed.  Six  repre- 
sentative tasks  were  chosen  for  the  study:  (1)  obtaining  a tool  from  a rack, 
(2)  returning  the  tool  to  the  rack*  (3)  removing  a nut;  (4)  placing  samples 
in  a storage  bint  opening  and  closing  a valvSt  and  (6)  digging  with  a 
shovel.  The  experiments  were  performed  under  simulated  conditions  using  four 
forms  of  manual  control  (i.e.t  switch  ratet  joystick  ratei  master- slave  posi- 
tion control t and  master-slave  with  force  feedback) t as  well  aa  supervisory 
control.  Through  these  experiments  the  effectiveness  and  quality  of  control 
were  evaluated  on  the  basis  of  the  time  required  to  complete  each  portion  of 
the  task  and  the  type  and  number  of  errors  which  occurred. 

Even  under  the  %est'*  control  conditions  (i.e.«  no  degraded  sensor  or 
control  loops  due  to  time  delaysy  restricted  bandwidthSy  etc.)  supervisory 
control  was  found  to  improve  performance  for  all  forms  of  manual  control 
except  force- re  flee  ting  master-slave  which  was  found  to  be  slightly  faster 
than  supe^isory  control « b rtore  prone  to  errors.  With  degraded  sensor  or 
control  loops  it  is  fairly  predictable  that  supervisory  control  will  show 
even  more  advantage,  through  the  latter  experiments  are  yet  to  be  done* 

1 . nmoDucTioM 

Teleoperators  have  traditionally  relied  on  relatively  simple  and  direct 
man-machine  interfaces  control.  However,  with  the  advent  of  microcom* 
puters  and  advanced  sensor  techniques  it  is  now  possible  to  design  and  build 
a hierarchical  control  system  in  which  the  operator  is  responsible  for  the 
higher-level  functions  related  to  the  unpredictable  portions  of  the  task, 
while  the  subordinate  machine  performs  the  SK>re  well-defined  subtasks  under 
human  supervision.  Control  based  on  a supervisor-subordinate  relationship 
such  as  this  is  called  **supervisory  control**  general,  the  hwan 
operator  coaminicates  intermittently  with  the  computer,  and  the  computer,  in 
turn  and  continuously  in  time,  controls  the  sensors  and  actuators  of  the 
vehicle  and  manipulator.  In  essence,  the  teleoperator  system  acts  as  an 
autonomous  '* robot'*  for  short  periods  while  in  the  pursuit  of  task  goals  pre- 
viously programmed  by  the  operator  or  updated  on  the  last  cycle  of  coaminica- 
tion.  This  mode  of  control  promises  more  precision  for  certain  tasks,  less 
susceptibility  to  failure  in  the  event  of  communication  channel  breakdown, 
and  greater  efficiency  than  direct  human  control. 
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to  invest ig«to  the  relative  aerits  of  supervisory  control  applied  to 
teleopera tors t a task^referenced  sensor-aided  supervisory  systesf  called 
SUPERMAN > vas  built  and  experiaents  vere  perforaed.  Thia  paper  will  evaluate 
those  experiaents  and  b^  coaparison  of  various  conventional  control  aodes 
with  supervisory  control y deaonstrate  that  supervisory  aanipulatlon  does 
iaprove  perforaance  in  the  aajority  of  cases* 

2*  METHOD 


Apparatus 

The  aajor  eleaents  of  the  SUPERMAN  systea  are  a aodified  Argonne  E2 
aaster-slave  aanipulator  with  six  degrees-of-freedoay  a dedicated  control 
interface  (DASI)y  and  an  Interdata  70  cosiputer.  Designed  for  efficient  aan-* 
aachioc  interaction  with  both  analog  and  syabolic  control  input Sy  the  systea 
can  be  coManded  by  a Variety  of  conventional  control  aodes  as  well  as  super- 
visory* In  additiony  tiae  delay  and/or  noise  can  be  added  for  experiaental 
purposes* 

Using  both  analog  and  syabolic  cosaandsy  a aanipulatlon  can  be  taught 
and/or  deaonstrated  to  the  coaputer*  Trained  aanipulations  can  he  trans- 
foraed  froa  one  coordinate  systea  to  another  so  that  once  the  generic  charac- 
teristics of  a task  have  been  learned y the  aachine  can  perfora  siailar  tasks 
in  different  locations  without  further  training*  When  the  huaan  operator 
requires  a particular  trained  aanipulation  be  siaply  ** initialises'*  the  new 
coordinate  systea  relative  to  the  old  by  aoving  the  teleoperator  hand  to  the 
starting  point  of  the  task  (e*g*y  grasping  a nut  or  valve  handle)  and  signals 
for  execution*  Certain  objects  in  the  task  environaent  cany  of  course y aain- 
tain  their  original  coordinates.  For  a coaplete  developaent  of  task  trans- 
fomacions  related  to  supervisory  control  see  refs.  2 and  3* 

Since  the  aanipulator  can  sense  the  forces  generated  during  the  task, 
supervisory  progrsas  can  call  for  repeated  aoveaents  which  y upon  certain 
touch  conditions  becoaing  trusy  branch  into  other  aovaients*  For  exaapley 
repeated  hand  aoveaents  can  grasp  a nuty  unscrew  it  by  one  revolutiony  pull 
back  to  test  whether  it  is  off  andy  if  it  iSy  place  it  in  a bucket  ory  if  it 
is  not I repeat  the  operation*  Siailar  supervisory  progrsas  have  been  applied 
to  attaching  a nut  to  a bolty  opening  and  closing  a valve y scooping  dirt  and 
so  on.  Further  information  on  the  SUPERMAN  systea  can  be  found  in  ^ef.  3* 

&ne  aanipulator  laboratory  was  arranged  as  shown  in  fig*  1 during  the 
experiaents*  To  siaulace  reaote  conditions  the  operator  viewed  the  task 
enviroiaient  through  either  a mono  or  2-view  television  systea*  The  video 
system  consisted  of  two  black  and  white  high-resolution  9 in*  monitors y a 
fixed  camera  with  wide  angle  lensy  and  a sooa  cmmrr  with  pan  4 tilt* 

Figure  2 shows  the  aanipulator  environaent  and  the  experiaental  tasks 
designed  for  this  study*  The  tool  rack  and  sample  buckets  remained  in  the 
locations  shown  throughout  the  experiaents  since  these  pieces  of  equipment 
are  usually  rigidly  attached  to  the  teleoperator  vehicle  in  real  applica- 
tions. Also  shown  in  the  figure  are  the  movable  task  hub  and  task  board  on 
which  representative  tasks  such  as  valves y bolts y etc  were  mounted*  The 
location  of  the  task  hub  and  board  were  changed  throughout  the  study  to  simu- 
late the  random  task/vehicle  relationships  which  are  typical  of  the  arbitrary 
environaents  found  in  narine  and  space  applications* 
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Kxpri— nf  I D^iign 

Six  bxiic  tasks  vara  idantifiad  for  axpariaantal  invast igat ion: ^ (1) 

tool  ratriavsl;  (2)  tool  ratum;  (3)  taking  a nut  off;  (4)  grasping  an  objact 
and  placing  it  in  a containar;  (5)  opaning/closing  a valva;  aad  (6)  digging. 
In  addition,  four  annual  control  sodas  vara  dalinaatad  as  iaportant  axpari* 
aantal  paraaatat':  (1)  svitch  fixad  rata;  (2)  Joystick  variabla  raca;  (3) 

aastar-slav^  ition  control;  and  (4)  aastar^alava  position  control  vith 
fores  raflaction.  Vith  ragard  to  tha  vidao  arraagaaant.  both  aono  and  2-viav 
conditions  vats  tastad  for  coaparison,  Dua  to  tiaa  constraints  only  thraa 
subjects  vara  usad  for  four  of  tha  tasks  (tool  ratriavalf  tool  raturOt  nut* 
off  and  saaplsr),  and  only  ona  subjact  vas  usad  for  tha  raaaining  tvo  (opan/ 
doss  valva  and  diggar).  Each  axpariaant  vas  parforaad  3 tiaas  by  aach  sub* 
jset  to  obtain  a statistical  as#  and  standard  daviation*  Both  annual  and 
suparvisory  control  vara  usad. 

Thass  conditions  rasult  in  a total  of  1120  axpariaantal  runs.  Sinca 
this  vould  raquira  an  inordinata  saKMint  of  tiaa,  tha  axpariaantal  load  vas 
rsducsd  CO  6B0  runs  by  noting  that  soaa  of  tha  tasks,  or  portions  '^f  tha 
tasks,  had  constant  coaputsr  sxacution  tiaas  (saa  raf.  3 for  datails). 

Subjects  and  Trsinina 

Three  classes  of  subjects  vara  usad  for  thasa  expariaants,  ona  expari* 
enced,  four  vail  trained,  and  tvo  untrained  subjacts. 

Tha  vail  trained  subjacts  had  an  avaraga  of  20  hours  training  given  in 
13  ainuta  intervals  for  aach  of  tha  control  aodas.  Canarally,  after  tha  sub* 
jacts  practiced  for  13  ainutas  vith  a particular  control  aoda  a siaulatad 
task  vas  parforaad.  Whan  the  subjacts  appeared  to  show  a plateau,  expari* 
aenls  wra  begun.  Sinca  Che  expariaants  usually  stretched  over  a period  of 
several  days,  the  subjects  vara  asked  to  **raparfora*'  soaa  of  tha  tasks  dua  to 
a **aistake".  If  tha  subjects  showed  aarkad  iaprovaaant  the  tasks  vara  par* 
foraed  again  until  the  learning  curve  lavallad  off,  Tha  four  trained  sub* 
jeeCs  vare  given  incentives  to  perform  veil  in  the  fens  of  bonuses  which 
vould  be  avarded  to  tha  bast  coabinad  time  and  error  rates  in  any  control 
category. 

Tha  first  author  was  usad  as  the  baseline  experienced  subject.  Vith 
over  200  hours  of  practice  on  aanipulator  systaas  and  intlmata  knowladga  of 
the  SUFBEM4II  syttaa,  it  may  be  reasonably  assiaad  that  tha  axpariancad  sub* 
ject  underwent  litrla  or  no  learning.  Tha  axpariancad  subjact  performed  all 
of  tha  tasktt  without  a **varmrup"  period. 

The  untrain^  subjects  had  a total  of  3 hours  training  time  for  all  con* 
trol  modes  (i.e.,  30  minutes  par  control  mode  and  viewing  condition).  The 
learning  curves  of  the  untrained  subjacts  vara  not  observed.  The  only 
requirement  placed  on  their  training  sessions  was  to  insure  that  aach  control 
nod#  was  given  equal  training  time.  After  tha  3 ona*hour  fsmiliaric*'  and 


^Although  it  may  appear  that  the  tool  retrieval  and  return  tasks  are  simply 
the  reverse  procedure  of  one  another,  these  tasks  do  have  fundamentally 
different  raquiramants.  To  clarifv,  consider  that  tha  retrieval  task 
required  the  subjects  to  locate  a lit  x 3/4  inch  t*^l  handle  vith  tha  end 
effector  docking  plate  vhile  the  return  taek  required  the  subjects  to  mate 
tvo  1/8  inch  pins  and  holes. 
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•djustse^t  periods  were  ovrr  cn«  subjects  wsrs  sllovsd  7^  hours  of  rest 
and  Che  expevismts  were  begun. 

Procedure 

The  experiments  were  scored  on  the  basis  of  recorded  time  end  errors. 
The  subjects  were  not  given  specific  instr\%ctioos  to  minimise  either  ^ality^ 
but  only  to  weigh  them  equally.  Each  subject  wast  however,  given  a criterion 
by  which  successful  completion  of  the  cask  would  be  measured  (these  criteria 
will  be  specified  on  the  following  pages).  The  experiments  were  not  redone 
when  errors  occurred,  regardless  of  the  magnitude,  unless  it  was  impossible 
to  proceed  with  the  task  (e.g.,  a collision  with  an  object  that  blew  a ruse, 
etc*)*  The  tasks  were  randomised  whenever  possible  to  negate  the  effects  of 
variables  which  the  experimenters  were  not  aware  of  (e.g*,  particularly  easy 
or  difficult  taek  positions,  short  term  learning  effects,  etc.).  All  tasks 
started  from  a prespecified  position  so  that  comparisons  of  supervisory 
initialisation  times  could  be  made  across  control  modes. 

The  procedure  for  each  of  the  representative  tasks  was  as  follows: 

a)  Tool-Eetrleval  Task  - The  first  task  required  the  subject  to  start 
with  the  end  effector  positioned  near  the  task  hub.  On  the  experi^ 
menter*s  signal,  the  subject  moved  the  end  effector  tc  the  tool 
rack,  obtained  the  tool,  being  sure  it  was  properly  seated  in  the 
hand,  and  returned  *ith  the  tccl  to  the  starting  postion.  The  sub* 
jects  were  told  that  the  success  or  failure  of  the  task  was  measured 
by  whether  a scHd  connection  between  the  tool  handle  and  end  effec* 
ter  was  achieved.  Execution  of  this  task  under  supervisory  control 
simply  involved  a button  push. 

b)  Tool*Retum  Task  - For  the  second  task  the  subject  started  from  a 
position  next  to  the  task  hub  with  the  tool  in  hand,  and  on  the 
experimenter’s  signal,  sK>ved  to  the  rack,  replaced  the  tool  insuring 
that  it  was  properly  seated,  and  returned  to  the  initial  position* 
The  operators  were  told  that  the  success  or  failure  of  the  task  was 
determined  by  whether  or  not  the  tool  was  properly  replaced  on  the 
rack*  To  properly  seat  the  tool  on  the  rack  required  that  both  of 
the  1/8  inch  rack  pins  were  engaged  in  the  handle  and  that  the  tool 
was  completely  pushed  onto  the  pins.  This  task  was  executed  under 
supervisory  control  through  a simple  button  push. 

c)  Nut*Removal  Task  - This  experiment  began  with  the  end  effector  posi- 
tioned over  the  valve  on  the  task  hub*  On  the  experimenter's  sig- 
nal, the  subject  moved  the  end  effector  from  the  valve  to  the  nut, 
oriented  the  hand,  and  removed  the  nut.  The  general  procedure  used 
by  the  subjects  and  computer  was  to  turn  180^,  pull  back  to  test 
if  the  nut  was  off,  and  then  aither  revaraa  180^  and  continue,  or 
remove  the  nut.  ^rior  to  the  tass,  the  operators  were  told  that  tha 
task  would  be  considered  successfully  completed  if  the  nut  could  be 
removed  without  losing  it.  Under  supervisory  control  ihe  operator 
initial ixed  the  task  by  moving  from  the  starting  poaition  to  the 
nut,  orienting  the  hand  with  the  rotational  axis  of  the  nut,  and 
signaling  the  computer  to  remove  it. 

d)  Sampling  Task  - The  fourth  task  required  the  subject  to  pick-up 
thirteen  randomly  placed  samples  and  put  them  in  one  of  two  buckets 
according  to  their  sice.  The  subjects  were  told  thsv  their  success 
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or  failure  to  cooploto  tho  task  would  ba  aaaaurad  by  bow  May  aai^ 
plus  wavu  auccaaafully  placad  in  tba  propar  buekata*  Uodar  aupar* 
viaory  control  tba  oparator  initial iaad  tba  task  by  placing  tba  and 
atf actor  ovar  tba  aanpla  and  signaling  tba  conputar  to  placa  it  in 
tha  appropriata  buckat*  Tba  conputar  ratumad  control  to  tba  tub* 
jact  at  tba  location  warn  tha  aanpla  was  graapad.  tba  oparator  than 
novad  to  anotbar  aanpla,  initialitad,  and  continuad  until  all  13 
aanplaa  wars  in  rba  buckata* 

a)  Opan/Cloaa  Valaa  Taat  - Tbia  axparinant  ra^irad  tba  aubjact  to 
position  tba  and  af factor  ovar  tba  nut  on  tba  task  bub,  and  than,  on 
tba  axparinnntar'a  signal,  tba  aubjact  noaad  to  tba  aalaa,  oriantad 
tba  hand,  and  opanad  or  cloaad  tba  aalua  an  raguirad  (opaning  and 
closing  tasks  wars  switcbad  aftar  sack  axparinant)*  Tba  aubjact  van 
raquirad  to  continua  until  tba  aalaa  oparation  was  conplata.  To 
initial isa  this  task  undar  suparaisory  control  tba  oparator  oriantad 
tha  and  af  factor  on  tba  rotational  axis  of  tba  aalaa  and  signalad 
tha  conputar  aitbar  to  opan  or  closa  it  as  raguirad*  Tba  conputar 
cbackad  tba  rotational  torquas  to  datamina  if  tba  task  bad  baan 
conplatad. 

f)  Dittina  Task  - Tba  final  task  raquirad  tba  subjact  to  rnnous  a spa* 
cifiad  nnount  cf  soil  fron  a box  by  filling  a buckat  with  a sboral* 
This  task  is  conposad  of  a nunbar  of  subtaskst  (1)  tba  aboval  is 
positionad  to  ranora  tha  soil,  (2)  tha  shoral  is  pusbad  into  tha 
soil  and  liftad  out,  and  (3)  tha  soil  is  transportad  to  tba  buckat 
and  droppad  in*  Tba  subjact  was  taquirad  to  continua  until  tba 
buckat  was  fillad.  Dndar  suparwisory  control  tba  positioning  of  tha 
shoval  was  parfomad  nanually  (i.a*,  tba  oparator  dacidad  whan  and 
wham  to  dig)  whila  tha  scooping  and  dropping  actions  wars  axacutad 
by  tha  conputar* 


3.  nSDLTS 

It  has  baan  shown  bv  a nunbar  of  invastigators  that  tha  tins  mquirad  to 
parfom  a task  can  ba  attributad  to  a nunbar  of  distinctly  diffamnt 
notions.  For  axanpla,  ona  classification  dividas  tha  task  tins  for  control 
with  a tins  dalay  into  savants  mlatad  to  Mt,  transport,  and  position 
notfirns  [^3*  * pag*in*tha*hola  task  Hill  ^53  has  shown  that  tbam  am 

two  indapandant  notions  which  dataraina  tba  tot^  task  tins  undar  nanual  con* 
trol  - gross  traval  and  pmcision.  This  papar  will  usa  a sinilar  schaan  to 
dascriba  tha  task  conplation  tins  for  a suparvisory  systant 

'tt  ■ ‘t  ♦ S 

wham  • 

t_  • Task  Tina 
TT 

• Tina  raquirad  by  tha  hunan  oparator  to  initialiia  tha  task. 
This  tins  is  priMrily  a function  of  tha  initial  hand f task  Iocs* 
tions  and  tha  nanual  control  noda  usad  to  locata  tha  task. 

tp  ■ Tina  raquimd  by  tha  conputar  to  par  Torn  tha  task.  This  tins  is 
prinarily  a function  of  tha  task  conpTaxlty. 

Tha  datamination  of  thasa  tinas  it  rathar  sinpla  dua  to  tha  discontinuity  in 
control  which  occurs  during  tha  trada  fron  nanual  initialisation  to  conputar 
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execuCioo  (this  '^discontinuity*'  is  a desired  result  since  trading  of  control 
should  be  ''apparent**  ^3>63)* 

Figures  3-6  are  plots  of  typical  data  (see  legend  belov  for  figure 
abbreviations).  The  data  recorded  during  the  supervisory  experiments  have 
been  divided  into  initialization  and  performance  times  to  indicate  the  time 
spent  by  each  action.  Each  of  the  time  bars  is  the  result  of  oata  averaged 
over  tvo  trained  subject s,  except  for  fig.  6 which  is  averaged  over  three 
trained  subjects.  The  lines  to  the  left  of  the  manual  control  birs  give  the 
range  over  which  the  trained  subjects  performed  the  task.  Fo^  comparison, 
the  average  time  for  an  inexperienced  subject  to  perform  the  first  three 
tasks  is  also  given  (denoted  by  triangles).  The  mean  times  of  the  untraii^ 
subjects  were  always  above  the  maximum  value  of  the  trained  s objects  for  the 
same  task  and  control  mode.  The  lower  portion  of  each  figure  (figs.  3b-6b) 
plots  the  mean  number  of  errors  whici  occurred  under  manual  and  supervisory 
control  (for  a specific  breakdown  of  the  individual  errors  see  ref.  3). 

LEGEND;  Key  to  Abbreviations  Used  in  Text 

MS  - Master-slave  with  force  feedback 
MS  NO  FTS  - Master -slave  without  force  feedback 
JVkC  - Joystick  variable  rate  control 
SVRC  - Switch  fixed/variable  rate  control 

4.  EVALUATION 


Manual  Control 

Predictably,  the  task  completion  time  increased  with  control  complexity 
for  all  tasks.  Viewing  conditions  (mono  and  2-view)  appeared  to  affect  tasks 
which  required  precision  movements  (e.g. , return  tool  and  nut-off),  but  had 
little  or  no  effect  on  the  less  precise  tasks  (e.g.,  sampling).  In  general, 
the  number  of  ervsjrs  increased  as  the  control  complexity  increased  from 
master-slave  tc  switch  rate.  However,  for  some  of  the  tasks  a sharp  decrease 
in  errors  was  noticed  between  joystick  and  switch  rate  control  (e.g.,  see 
figs.  5b  and  6b).  This  effect  is  attributable  to  t«io  factors:  (1)  the 

increased  attention  and  care  each  operator  exhibited  during  switch  rate  con- 
trol modes  (i.e,  to  move  from  point  A to  point  B requires  considerable 
thought  and  effort  with  switch  rate  control,  ^t  under  joystick  control  the 
desired  movement  only  requires  a push  on  the  stick),  and  (2)  the  coincidental 
matching  of  the  task  degrees  of  freedom  and  control  degrees  of  freedom  (e.g., 
in  the  valve  or  nut-off  tasks  the  axis  of  rotation  corresponded  with  the  hand 
axis  of  rotation). 

Table  I gives  the  ratio  of  task  completion  times  for  each  control  mode 
with  respect  to  the  "best”  control  case,  master-slave  with  force  feedback. 
The  ratios  are  given  for  each  subject,  task  and  viewing  condition.  The 
untrained  subjects  are  denoted  by  U1  and  U2,  the  trained  subjects  are  denoted 
by  Tl,  T2,  T3  and  T4,  and  the  experienced  subject  is  denoted  by  £1.  The 

table  shows  a niaber  of  interesting  trends:  (1)  the  ratios  increase  with 

increasing  control  complexity,  (2)  the  ratios  are  approximately  constant 
across  subjects  (both  trained  and  untrained)  within  a given  task,  (3)  the 
ratios  are  constant  across  viewing  conditions,  and  (4)  the  ratios  are  not 
constant  across  tasks  (the  tasks  have  been  arranged  in  the  table  so  that  the 
ratio  increases  as  the  page  is  read  from  top  to  bottom).  A number  of  other 
irvestigators  have  found  similar  trends  t^,8,9,103. 
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Fig.  3«:  Av«r«f€  Tool*lt#cri«v«l  TIm.  Each  har  givat  cha  avaraga  tiaa 

of  tao  Aubjacca.  Tha  A a^fvbol  rapraaanta  cha  Man  ciaa  for 
an  untrainad  anbjact.  Tha  cappad  liaaa  show  cha  Cocal  ranga 
of  daca  for  cha  crainad  aubjacCs. 


Fig.  3b:  Expaccad  Eisbar  of  Too 1-Racri aval  Errora.  Each  data  poinc 

rapraaanca  cha  avaraga  arror  raca  of  Cwo  Crainad  aubjacCa. 
Poaaibla  arrora  includad  colliaiona,  dropping  cha  cool, 
and  not  aaacing  cha  handla  in  Cha  and  affactor  proparly. 
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ig.  4«:  Average  Tool-EeCum  Tiae*  Each  bar  repreaenta  the  average 

tiM  of  Cifo  trained  aubjecta  and  each  A givea  the  aean 
tiae  for  an  untrained  aubject*  The  capped  linea  repreaent 
the  total  range  of  data  for  the  trained  aubjecta. 


Fig.  4b:  Expected  Nuaber  of  Tool-Return  Error a.  Each  data  point 

.epreaenta  the  average  error  rate  of  tvo  trained  aubjecta. 
Poaaible  errora  included  colliaiona,  dropping  the  tool, 
and  not  aeating  the  handle  on  the  rack  properly. 
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ig.  5«:  Av«rag«  Hut-E«MV<1  TiM.  B«ch  bar  rapraaancs  Cha  avaraga 

tiaa  of  two  trainad  aubjacta  and  aach  A givaa  tha  aaan 
tiaa  for  an  untrainad  aubjact.  Tha  cappad  linaa  rapraaant 
cha  total  ranga  of  data  for  tha  trainad  aubjact. 


Fig.  5b:  Expactad  Niabar  of  Rut^Ranoval  Brrora.  Each  data  point 

rapraaanta  tha  avaraga  arror  rata  of  two  trainad 
aubjacta.  Poaaibla  arrora  includad  colliaiona  and 
droppir^  tha  nut. 
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MS  MS  jvm:  svnc 

NOF^B 


MS  MS  JVfK  SVIK 
NOFTB 


ExpBctfld  Ntal>«r  of  Scapliug  Errors.  E«ch  d«ts  point 
roprssBiits  th«  avBrBgo  trror  rat#  of  thraa  trainad 
aubjacta  for  13  aaKpling  actions • Poaaibla  arrora 
includad  collisiona,  taiaaad  buckata»  lost  asMplaa, 
and  (undar  auparviaory  control)  praaaing  tha  wrong 
button. 
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T«bl€  I:  Ratio  of  TIm  to  Perfora  Task  Undar  Givan  Control  Moda  to  TIm 

to  Parfom  Task  Undar  Mastar-Slaaa  with  Forca  Faadback  (GM/HS). 
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Suparviaory  Control 

Aa  ifould  ba  axpactad^  tha  tiaa  ra<|uirad  by  tha  coaputar  to  parform  ita 
portion  of  tha  tank  rasainad  fizad  ragardlaaa  of  tha  aannal  control  soda  froa 
which  tha  hiaan  oparator  iaauad  tha  axacution  coMand*  Alto,  ainca  tha  only 
action  raquirad  of  tha  oparator  to  initiata  tha  tool*ratriayal  and  ratum 

taaka  waa  a button  puah,  fha  abaanca  of  initialisation  tiMa  in  figa.  3a  and 
4a  vaa  not  aurpriaing.  Tna  ranaining  taaka , including  thoaa  not  ahown  in 

thia  papar,  had  initialisation  tinaa  aajociatad  with  tha  oycrall  taak  tiaa* 
Aa  aaan  in  figa.  5 and  6 tha  initialisation  tinaa  incraaaad  with  control 

coBplaxity* 

^4bla  2 giyaa  tha  ratios  of  tha  taak  conplation  tinaa  undar  nanual 

conIro^  to  tbs  tinaa  undar  aupanriaory  control*  The  ratios  ara  giran  for 
each  MUthjtcC , taak  and  yiawing  condition*  Tha  ratios  ralatiya  to  computer 
control  (Tab*.it  2)  do  not  show  tha  sana  trends  aa  thoaa  ralatfya  to  aaatav- 
alavtt  cont^o^  (Table  1)*  It  is  intaraating  to  note  that  in  contrast  to  tha 
coraiatant  ratios  of  Table  It  the  coaputar  control  ratios  of  tha  untrained 
subJiiCts  sfa  significantly  higher  than  tha  trained  subjactss  claarlyt 
untrained  aubjacta  ^ain  aora  froa  suparyiaory  control  than  trained  subjects • 
Gains  froa  suparviaory  control  for  any  manual  node  ara  seen  to  ba  most  aigni*- 
ficant  for  tasks  which  do  not  raquirs  initialisation  procedures  other  than  a 
button  push  (i*a*t  tool*ratrisyal  and  tool*ratum)*  The  control  aoda  coluans 
clearly  indicate  tha  results  of  tha  SUPRSMAR  axpariaantsi  (1)  aastar-slaya 
with  force  faadback  rarely  benefits  froa  supervisory  control,  (2)  aastar* 
slave  without  forca  faadback  can  profit  froa  aupanriaory  control  in  tasks 
which  require  forca  feedback,  and  (3)  both  forms  of  rata. control  can  ba  aided 
by  aupanriaory  routines  ragardlaaa  of  tha  task* 
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Tftbltt  2:  Ratio  of  Tisa  to  Perfors  Task  Undar  Hanual  Control  to  Tiaa  to 

Parfora  Task  Undar  Suparviaory  Control  (HC/SC). 
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In  all  caaas  the  error  rates  for  supervisory  control  vara  less  than  aan- 
ual  control.  Hovevert  an  interesting  error  was  noted  during  the  saapling 
expariaants  * occassionally  the  subjects  pressed  an  incorrect  button  sending 
the  saaple  to  the  vrong  bucket. 


5.  DISCUSSION 

Theoretically  there  is  no  reason  vhy  aaster-slave  vith  force  feedback 
should  be  any  faster  than  supervisory  control.  Consider  that  the  coaputer 
could  siaply  aiaic  the  hiaan  operator's  bast  tiajectory^  and  hencey  be  at 
least  as  fast.  Unfortunately 9 in  practice  thar*  is  always  a certain  overhead 
associated  with  re transformation  of  coordinates , trajectory  calculations  and 
sensor  logic.  Also 9 it  was  generally  observed  that  the  subjects  were  making 
adaptive,  orchestrated  motions,  whereas  the  computer  was  limited  to  more 
rigidly  defined  trajectories  and  states.  In  light  of  these  observations  it 
can  be  said  that  the  faster  master-slave  times  make  more  of  a statement  about 
the  direction  that  future  studies  dealing  with  supervisory  control  should 
take  than  they  do  about  its  potential  in  teleoperator  systems. 

Although  the  experiments  were  not  designed  to  measure  the  effectiveness 
of  supervisory  control  during  extended  periods  of  manipulation,  an  interest- 
ing observation  was  made  after  the  experiments  had  been  completed  - the  man- 
ual experiments  had  been  performed  vith  rest  periods  between  each  run  because 
the  subjects  complained  of  fatigue  and  boredom,  while  the  supervisory  experi- 
ments had  been  unintentionally  run  back-to-back  since  fatigue  and  boredom 
were  not  noted.  From  thes  ' observations  it  could  be  surmised  that  as  a task 
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becoMs  won  involved  end  cosplez,  boredoa  end  fetigue  will  becow  increae- 
ingly  important  factors,  tipping  the  scales  even  further  in  favor  of  supex^ 
visory  control.  However,  experiments  to  validate  this  statement  have  yet  to 
be  performed. 


6.  COHCLUSION 

Even  under  "ideal*^  control  conditions  i»upervisory  control  was  found  to 
be  more  efficient  and  effective  (as  determined  from  the  task  completion  times 
and  manipulation  errors)  than  switch  rate  control,  joystick  rate  control,  and 
master^slave  position  control.  Bilateral  force~re flee ting  master-slave  was 
found  to  be  slightly  faster  than  supervisory  control,  but  more  prone  to 
errors.  Since  the  experiments  were  performed  under  "ideal**  conditions,  it 
can  be  reasonably  predicted  that  supervisory  control  will  show  even  more 
advantage  when  used  with  degraded  sensor  or  control  loops  (e.g. , time  delays, 
limited  bandwidth,  etc.),  though  the  latter  experiments  remain  to  be  done. 
In  addition,  an  a posteriori  observation  of  the  experimental  procedure 
appears  to  indicate  that  the  effects  of  operator  fatigue  and  boredom  during 
extended  periods  of  manipulation  can  be  significantly  reduced  through  super- 
visory control. 
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Abstract 

An  .enhanced  proximity  sensor  and  display  system  has  been  developed  at 
the  Jet  Propulsion  Laboratory  (JPL)  and  tested  on  the  full  scale  Space  Shuttle 
Remote  Manipulator  at  the  Johnson  Space  Center  (JSC)  Manipulator  Development 
Facility  (MDF) . The  sensor  system,  integrated  vith  a four*claw  end  effactor, 
measures  range  error  up  to  6 inches,  and  pitch  and  yaw  alignment  errors  vithin 
±15  deg.,  and  displays  error  data  on  both  graphic  and  numeric  displays.  The 
graphic  display  shows  pitch  and  yaw  errors  with  1 deg.  resolution  and  range 
error  with  0.2  Inches  resolution  In  an  Integrated  format.  The  nu^oeric  display 
resolution  is  0.1  inch  for  range  errc.  and  0.5  deg.  for  pitch  and  ys'^  errors. 

The  errors  are  referenced  to  the  end  effect^'^  control  axes  through  appropriate 
data  processing  by  a dedicated  clcrocomputer  acting  on  the  sensor  data  in  real 

time.  Both  display  boxes  contain  a green  lamp  which  indicates  whether  the  

combination  of  range,  pitch  and  yuw  errors  will  assure  a succescful  grapple. 

More  than  200  test  runs  were  completed  in  early  1980  by  three  operators  at  JSC 
for  grasping  static  and  capttirlng  slowly  moving  targets.  The  test  goal  was  to 
investigate  methods  to  minimize  teminal  range  and  alignment  errors  by  utilizing 
range,  pitch  and  yaw  error  information  from  the  sensor  displays.  Reduced  errors 
will  reduce  preload  on  payload  grapple  fixture.  The  test  runs  aided  by  sensor  i 
displays  were  contrasted  with  test  runs  without  sensor  display  aids.  The  paper  1 

describes  the  enhanced  sensor  and  display  system,  the  test  runs  and  results.  | 

The  tests  have  indicated  that  the  use  of  graphic /numeric  displays  of  proximity 
sensor  information  improves  precision  control  of  grasp /capture  range  by  more  than 
J a factor  of  two  for  both  static  and  dynamic  grsT^ple  conditions. 

I 1.  INTRODUCTION 

haniial  control  of  the  15.2  m.  (50  ft.)  long  Space  Shuttle  Reoiote  Manipula- 
tor System  (RMS)  requires  a delicate  balance  In  the  Information  and  control  con- 
ditions. This  requirement  is  particularly  delicate  when  the  target  is  near  the 
grasp  envelope  of  the  end  effector:  a precise  knowledge  of  small  range  or 

alignment  errors  cai.  have  a large  effect  on  the  success  of  or  preload  ^^soclated 
%rlth  the  grasp.  j 

Previously  (Ref.  1),  a proximity  sensor  system  was  developed  at  the  Jet  | 

Propulsion  Laboratory  (J7L)  and  Integrated  with  a four-claw  end  effector  of  ' 

Johnson  Space  Center  (JSC).  The  sensor  system  coa"^sts  of  four  proximity  sen- 
sors, and  was  designed  to  supplement  the  visual  Intormatloa  for  control.  It  pro-  | 
*^des  guidance  data  to  the  operator  when  the  target  Is  near  the  end  effector's 
grasp  envelope  where  visual  perception  of  range,  pitch  and  yaw  eriors  are  poor. 

In  previous  ground  tests  at  the  JSC  Manipulator  Development  Facility  (MDF) , the 
use  of  the  sensor  system  was  restricted  to  the  verification  of  a "successful 
grasp  state"  before  the  operator  initiated  the  grasp.  Even  the  use  of  restricted  > 
proxlsU^ty  sensor  Information  proved  to  be  valuable  for  improving  coatrol  1 

performance. 
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In  ord*r  co  ftxc«nd  th«  utility  of  proxlaicy  s«nsor  inforMClon  for  frasp 
or  capture  control,  two  nnw  "smArt**  dlAplnyi  (a  graphic  And  a nuanrlc)  hAVA 
boon  devel op«d  At  JPL  And  cost Ad  ac  JSC  rtcAncly.  THa  purpoAA  of  chA  nAw 
displAVA  Is  CO  show  ChA  opArACor  th#  vaIuas  of  rAngA,  pitch  And  vaw  Acrors 
refArAnced  to  end  Aff Actor  Axes,  in  Addition  to  indicACing  vhAChAr  the  cottbi* 
nAtion  of  thASA  thrAA  Acrors  trill  Assure  a luccASAful  grxAp  of  chA  CArgAC.  The 
displAv  >f  rengA,  pitch  And  yew  error  vaIuas  vaa  A&cicipACAd  to  Aid  the  operAtor 
to  fiae-control  Che  grAAp  with  respAct  to  thesA  three  errors  vichin  the  gresp 
envelope.  The  tests  heve  verified  the  Ancicipeted  utility  of  the  detAiled  die- 
plAys  of  error  inforsACion,  but  relsed  a nueber  of  quAAtiooA  regArdlng  a useful 
InCAgTAtioc  of  proximity  seoAor  sod  visuel  infonsACion, 

2.  "SMAir*  DISPUYS 

Th#  nAv  dlsplAys  ArA  being  used  with  the  proximity  sensor  system  devel* 
oped  for  the  previous  tests  In  1978  end  described  In  decsil  In  (Ref.  1).  Hov- 
ever,  the  effective  sensing  rsnge  of  the  sensor  system  hes  been  extended 
electronlcAlIy  from  S to  6.5  laches.  The  effective  depth  of  the  gresp  Aovslope 
of  the  four-clAv  snd  effsctor  1.  About  3 inches.  Consequeocly , the  SAosor  sys- 
csm  cen  look  shsAd  of  the  gresp  snvslope  by  3.5  inches.  The  use  of  this  sensor 
system  Implies  thst  ths  cvo  letcrel  end  roll  miselignmsnt  errors  vichin  chs 
gresp  envelope  ere  controlled  visuslly. 

The  grephlc  display  hee  been  built  from  10-elAmsnC  linear  L£D  displays 
encApsulkted  in  one  chip,  with  individusl  eddresssble  enode  end  cathode  for  each 
element  in  the  chip.  The  graphic  display  rssoluCioo  is  0.2  inches  )0.508  cm) 
per  display  elsmsnt  in  depth,  and  1 dagres  per  d..splsy  element  la  pitch  snd  yaw 
errors.  (See  Fig.  1.)  The  qusncitetive  value  of  each  error  bar  Is  incressing 
ssey  from  the  center  green  lamp.  Hence,  zero  error  for  each  her  is  at  chs  cancer 
of  chs  display.  This  focuses  chs  operator's  ectantioci  to  a single  "goal  point" 
on  the  displs'^  tovsrds  vhich  ell  error  bars  should  be  decreased  end  vhere  the 
"green  light ' ould  be  on  for  successful  grasp. 

Note  chat  depth  error  is  Indicecsd  with  cvo  identical  bars  converging  in  e 
pArAllnx«type  vlev  errengesNint  toverde  the  center  green  leap.  This  renders 
the  display  mora  syMAtric  and  faciliCACAS  the  distinccion  betveen  angular  and 
depth-error  bars.  The  green  light  "on"  condition  Indicates  Chet  the  existing 
combination  of  dapth,  pitch  and  yav  errors  vlll  sllov  a successful  grasp. 

The  graphic  dlaplay  alao  contains  a tona  ganarator.  It  providas  a "succssa 
tona"  (a  short  beep  tone,  - distinguished  In  frequency  from  the  "success  cons") 
when  Che  target  reaches  ths  sensing  rsnge  or  Issves  the  sensing  range.  The  maxi- 
mir.  epth  sensing  range  shovn  on  the  display  is  6 inches  (or  15  cm).  Fitch  and 
yaw  arrors  are  IndicACed  in  the  range  of  il5  deg.  Actually,  Che  veming  beep 
Cone  provides  an  advance  vamini^  since  it  is  ecilveted  at  a distance  of  about 
6.3  Inches  vhich  Is  not  shovn  on  the  display,  nw  display  la  activated  only  at 
6 Inches  distance. 

The  numeric  display  resolution  Is  0.1  inch  (0,254  cm)  in  depth  crro*..  snd 
0.5  deg  in  angular  errors.  It  also  hes  chs  "green  success  las".  Tha  numeric 
dlaplay  can  alao  be  applied  co  performance  evaluation  by  the  ua«.  of  a ho  Id /reset 
svitch.  This  svltch  cen  be  connected  the  grasp  roncrol  circuit.  Hence,  it 
can  automatically  register  che  re^l  lepth,  pitch  and  yav  errors  ^c  the 
moment  of  grapple. 

The  new  displays  are  driven  by  a aingle  board  Intel  80/20  mlcroprocesaor 
vhich  llnear^zea  tt^aenaor_^ca  j^  processes  the  _llnearl7ed  data  through  s 
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pr«S€l«cce<l  "success  4lgorlcW*.  An  4pproprl4t«  ”sur.'.'4s  algorlcW  can  b« 
salactad  in  tha  conpucar  through  a BO)  switch.  Tha  algorlthu  can  ba  rafarancad 
to  altamatlva  roll  orlantatlcms  of  tha  and  af factor  pitch  and  yair  axas,  and  can 
utlllza  altanatlva  mMric  daflnltions  for  **succasaful  grappla  anvalopa"  in  cac«a 
of  aaxtnun  and  ninlaua  valuas  of  allovabla  dapth.  pitch  and  yaw  arrors. 

Alt^gathar  32  display  driva  program  coablnations  hava  baan  iaplanantad:  2 algo- 

rltha  alternatives,  with  4 alternative  sets  of  paranetars  used  in  4 altamaciva 
rafaranca  fraoaas.  The  basic  "success  algoritW  is  tha  conic  algorlcha  (described' 
in  Raf.  I)  using  all  four  or  only  three  out  of  four  sensors.  Tha  four  sets  of 
trapezoid  paranatars  are  listed  in  Table  I together  with  the  BCD  program  select 
switch  assignments . 

Algorithmic  selection  of  pitch  and  yaw  rafaranca  axes  by  four  90  dag.  rota- 
tion steps  (sea  digit  X on  tha  BCD  dial  in  Table  1)  allows  four  altamatlva  and 
effector  mountings /viewings,  keeping  tha  pitch  and  yaw  error  display  format 
unchanged  in  tha  display  boxas.  Furthermore,  for  a fixed  and  effector  mounting/ 
viewing,  tha  algorithmic  rotation  of  pitch  and  yaw  rafaranca  axes  by  180  dag. 
will  change  pitch  and  yaw  error  polarity  in  the  display  format.  This  allows  two 
altamatlva  correlations  between  displacanant  direction  of  hand  controller  and 
corresponding  change  in  error  bar  length.  Tha  two  altamatlva  correlations  are: 
tha  error  bar  changes  length  a)  in  the  direction  or  b)  opposite  to  the  direction 
of  tha  hand  controller  displacement. 

Figure  2 sxHuirizas  the  sensor,  control  and  display  reference  frames 
together  with  tha  actual  pitch  and  yaw  error  statas  for  digit  X « 0 on  t.m  BO 
dial  swxtch.  The  mathematics  ralstad  to  chess  transformations  is  sxmmarized  in 
the  Appendix. 

Figure  3 shows  s target  approach  sequence  as  seen  on  the  "smart"  displays. 

In  Figure  3. a th^  four-claw  hand  is  outside  the  grasp  envelope  at  4.3  inches; 
the  center  green  lamp  Is  off.  In  Figure  3.b  the  four-claw  hand  is  Inside  the 
grasp  envelope  at  2.^  Inches,  and  the  combination  of  range,  pitch  and  yaw  errors 
allows  succassful  grasp;  graen  lamp  Is  on.  In  Figure  3.c  the  four-claw  hand  ia 
inside  grasp  envelope  with  greatly  reduced  errors  allowing  a fine-controlled 
grasp;  green  lamp  is  on.  Figure  4 shows  the  algorithmic  rotations  of  pitch  and 
ymw  error  axes  in  Che  displays  by  90  degree  steps  for  c fixed  end  effector 
mount  ing/ viewing . 

The  display  boxes  contain  the  appropriate  decoding  and  LED  drive 
electronics. 


3.  GROUND  TESTS 

More  than  200  test  runs  %rsre  completed  in  early  1980  by  three  operators  for 
grasping  static  and  capturing  slowly  moving  targets  using  the  simulated  full 
scale  Shuttle  manipulator  arm  at  the  JSC  MDF.  The  overall  test  goal  was  to 
Investigate  methods  to  minimize  terminal  range  and  misalignment  of  the  manipulator 
end  effector  by  utilizing  quantitative  Information  from  the  range,  pitch  and  ymw 
error  aenaor  disf»lays.  Reduced  errors  will  reduce  preload  on  the  payload  grapple 
fixture.  The  operetors  were  asked  to  observe  s predefined  error  margin  within 
the  graap  envelope.  The  teat  runs  aided  by  sensor  displays  were  contrasted  with 
test  runs  with  restricted  cr  no  sensor  display  aids.  In  this  last  esse  the  opera- 
tor had  CO  rely  ’jpon  direct  vision  and/or  TV  information.  The  TV  information 
waa  enhanced  with  visual  target  cues. 


609 


•JF 


POOR  Qb Ati  i / 


lAbl#  I.  P&r«MCer  secs  for  conic  slgorlrha  vlch 
crepesoid  forsule,  end  progrsa  select 
dlel  for  dlspley  drive  elgorlchM 


Digit  T 

“a 

“b 

s 

C* 

C 

1 or  5 

0-1 

0.8 

i-7 

2.4 

1.4 

2.0 

2 or  6 

0.3 

1.0 

1-7 

2.4 

1.4 

2.0 

3 or  7 

0.2 

C.9 

1.9 

2.6 

1.4 

2.0 

4 or  8 

0.4 

♦ 

l.l 

1.9 

2.6 

« 

1.4 

2.0 

1 

min 

■> 

1 

distance  (Inches)  for 
successful  grasp 

?rogr»  selecc  dlel 


The  test  feclllty  end^equipeient  heve  'been  described  in  detail  In  (Ref.  I) . 

The  grapple  target  counted  on  the  payload  represented  the  unit  used  in  the 
RMS  flight  system.  The  target  Is  used  In  conjunction  with  the  Closed  Circuit  TV 
(CCTV)  camera  mounted  on  the  wrist  of  the  manipulator,  which  is  controlled  in 
Che  end  fctor  coordinate  system.  This  reference  system  allows  for  the  opera- 
tor to  c .ol  the  tip  position  and  attitude  of  the  end  effector  using  only  the 

CCTV  camera  feedback  in  a **fly-co*'  manner:  a command  right  moves  tbs  end  effector 

CO  Che  right  along  its  Y axis,  a negative  roll  coMamd  rotates  the  and  effector 
counterclockwise  (viewed  down  the  arm)  about  Its  longitudinal  axis. 
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Thtt  vlsiial  CATgttt.  aouBCttd  «bov«  thm  grapple  flxtura,  la  dMlgoad  to  par- 
ole allgBBHit  of  th«  «o4  offoctor  to  vlcliio  l4  in.  and  ±13  dog.  of  tba  grappla 
flxcura.  Tha  vlaual  targat  and  Its  ralatloa  to  cha  grappla  flxtura  la  ahom 
actMoatlcally  .^n  Fig.  3*  Tha  cantar  tod  of  cha  vlaual  targat  proaldaa  cuaa  for 
Unaar  allgoMnc  (l.a. » horlsootai  and  vartlcal)  whan  uaad  irlth  a croaahalr 
ayabol  op  tha  CGTV  oonltor.  aa  vail  aa  angular  allgnoanta  of  pitch  and  jm,  loll 
cuaa  ara  avallabla  froo  cha  radial  lliiaa  vhan  uaad  vlth  tha  CC7V  aoaltor  horl- 
sontal  ..afaraoca  narka.  langa  laforaatloo  la  datamlnad  by  aatchlng  tha  11  lo« 
horlsootai  targat  llnaa  to  tha  roll  rafaranca  aarka  on  tha  CCtV  aooltor.  Dndar- 
atandably*  ranga  la  tha  ooat  difficult  paraaatar  to  dataralna  froo  tha  vlaual 
cuaa»  aapaclally  during  dynaadc  grappling. 

Tba  taac  nioa  ara  auaMarlsad  In  Tabla  2.  In  addition  to  tha  taat  runa, 
an  aqual  iBount  of  training  runa  vara  alao  conductad. 

In  tha  static  casts • tha  payload  was  locatad  In  tha  Sbutcia  payload  bay 
aa  shown  In  Fig.  6.  Tha  IMS  oparacor*  poaltlonad  at  tha  aft  cabin  workstation, 
attaaptad  to  all|p  tha  and  affactor  «rlth  tha  payload  grappla  flxtura  using 
altamatlva  co^lnatlona  of  visual  and  sanaor  display  aids  aa  ai^narlsad  In  tha 
taat  run  matrix  glvan  In  Tabla  2.  Tha  oparatora  warn  aakad  to  position  tha  and 
affactor  by  0.2  In.  off  the  grappla  flxtura  with  alnlnw  (saro  or  naar-saro) 
alignnant  arrors.  Whan  tha  oparator  Indlcatad  that  tha  positioning  and  allgnmant 
was  as  accuraca  aa  poaalbla>  cha  taat^  candugtpp-  nrarlr  itlanlav  bv  a 

Tabla  2.  Tast  run  matrix 


Run 

No. 

No.  Runs/ 

No. 

Motion 

Visual  Accass 

Oparator 

1 

static 

*0V  only 

3 

3 

2 

static 

DV  sanaor 

3 

3 

3 

static 

DV/TV  only 

3 

3 

4 

static 

DV/TV  sansor 

3 

3 

5 

static 

TV  only 

3 

3 

6 

static 

TV  sansor 

3 

3 

7 

dynamic 

TV  only 

3 

-.aa 

8 

dynamic 

TV  ^ go/ao-go 

3 

\J 

9 

dynamic 

TV  go /no-go 

ranga/att.  info. 

3 

6 

NOTES: 

1.  Each  oparator  racaivad  a training  sassion  to  familiar Ita  with  tha 
display  davicas  and  alignmant  oparatlons  prior  to  data  taking. 
Training  saaslona  vara  conductad  for  both  static  and  dynamic 
phasas  of  tha  ease. 

2.  Each  data  sassion  includad  soma  varm-up  runs. 

*DV  - dlract  vision 
TV  - closad  circuit  talavlalon 
runs  aach  at  0.1  and  0.2  ft /sac 
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raaocc  «vlcch»  thmrmby  MMurias  r«a(»«  pitch  «nd  ym  accuracy  achlavad  by  tha 
operator.  Tha  data  vara  racordad  aamially  for  analyala. 

la  tha  dyoaalc  casts*  tha  task  vas  to  capeura  a payload  cranslatlag  at  O.I 
and  0.2  ft/sac  spaad  across  tha  MDF  air  baarlng  floor.  Tha  payload  (a  black  box 
aqulppad  irlch  tha  grappla  flxtura  and  visual  targac)  vas  aountad  on  an  air  slad 
which  vas  pullad  across  tha  floor  using  a aotorizad  pullay  systaa.  Tha  puIXay 
syscaa  vas  placed  at  about  10  dag.  angla  ralatlva  to  tha  payload  bay.  Tha  opera- 
tors vara  askad  to  position  tha  and  affactor  as  close  as  posslbla  to  tha  grapple 
fixture  (preferably  by  0.2  la.  froa  tha  grapple  fixture)  vlth  alnlaua  allgnaant 
error.  During  tha  dynaslc  tests*  tha  display  locking  circuit  was  linked  to  the 
SIC  grasp  control  svltch  so  that  the  coaaand  to  execute  grasp  locked  tha  range* 
pitch  and  yaw  error  values  shown  on  tha  niaMrlc  display.  Tha  data  vara  recorded 
nanually  for  analysis. 

Tha  sensor  displays  ware  located  near  the  TV  eonltor  as  shown  In  Fig.  7. 
Figure  7 shows  a static  grasp  test  scene.  Th»  error  values  shown  on  the  displays 
are  the  actual  rzcors  of  tha  pre-grasp  state  that  can  be  seen  directly  throu^ 
tha  cabin  aft  window.  The  visual  assessMnt  of  range,  pitch  and  yaw  errors  Is 
quite  poor  relative  to  the  actual  arroi  values  shown  on  the  displays.  Figure  8 
shows  the  operators  using  tha  TV  snd  sensor  displays  during  tha  taste.  Figure  9 
shows  a dyniw^c  tsat  stena  viewed  fron  tha  air  bearing  floor.  Figure  10  shows  s 
precision  controlled  rs:.«e  poeltloning  for  dynenlc  capture.  The  visual  target 
described  in  Fig.  5 Is  presented  In  Fig.  10. 

The  following  date  were  collected  during  the  teats:  ties  to  aXign/esptura; 

grsppls  succsss;  grsppla  sUgfant  errors  (pitch,  yaw,  range);  subjective  operator 
cawMsnes;  video  taping;  novle  and  still  pbocogrsphy. 

4.  TEST  DATA  AMD  CTALOATIOII 

Table  3 presents  a brief  quantitative  siflaery  of  the  static  taac  data.  How^ 
ever*  caution  auat  be  exerciaed  in  drawing  concluslona  froa  data  related  to  e 
stacisclcal  population  of  thrae  teat  operators.  Aa  seen  In  Table  3,  the  use  of 
Che  graphic  snd  massrlc  sensor  displays  laproves  precision  positioning  perfor- 
aancs  by  wore  Chen  s factor  of  two.  This  result  applies  to  the  training  runs  as 
well  as  to  the  final  r*ns.  The  average  errors  are  cowputed  relative  to  the 
0.2  in.  off- range  frow  Che  grapple  fixture  Che  operators  were  asked  to  observe. 
Hence*  the  crus  Individual  errors  srs  plus/wlnus  errors.  The  lOOZ  green  Is^p 
"on**  result  Indlcscsa  rlist*  using  the  sensor  displays,  the  operators  never  vent 
below  the  requastad  0.2  in.  off-range.  Wichout  senaor  displays,  tha  operators 
could  control  this  :oodltion  only  with  63t  success.  That  la.  In  one  out  of  three 
cease  they  vent  below  Che  0.2  In.  off-rsnge.  Mote  also  that  training  has  s con- 
sldarsble  affect  on  the  final  raaults.  The  final  run  data  are  In  each  case 
better  by  a factor  of  two  as  cohered  to  Cha  training  run  data. 

Table  4 presents  a brief  q«iantlcetlve  scasury  of  the  dynswlc  ceet  data.  In 
this  table*  cte  average  errors  are  cowpuoed  rslstlve  to  a true  tero*le\el  error. 

As  seen  again*  the  cxanilsClve  (total)  rssult  Is  chac  ths  use  of  the  graphic  snd. 
ntsMrlc  sensor  displays  Inproves  precision  positioning  performance  by  s factor  of 
two.  Hovwvar*  in  the  dyna^c  case  there  are  interesting  Individual  (hiaan 
factors)  variances.  For  one  operator*  chs  grsphlc/mMrlc  display  did  not  help 
coo  much;  ha  obtained  the  factor  of  two  perfois^ence  Improvement  by  using  only  the 
"green  lawp"  sensor  display.  But  for  another  opexator*  tha  use  of  the  graphic/ 
numeric  displays  actually  helped  to  improve  the  precision  positioning  performance 
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Tablft  3.  Siiammrj  of  static  Cast  data 


Using  sensor  displays 

Vlthout  sansor  displays 

Average 

range 

error  (In.) 

Green 

success 

Imp 

"on" 

Averaga 

range 

error  (In.) 

27  Training  runs 

0.23 

no  da*^« 

0.48 

no  data 

27  Final  runs 

0.075 

lOOZ 

0.2 

63Z 

Table  4.  SuiMury  of  dynaadc  test  dara 


Using  graphic 
and  numeric 
sensor  displays 

Using  only 
"green  lamp" 
sensor  display 

Without 

sensor 

displays 

Operator 

Average 

range  error  (in.) 

Average 

range  error  (in.) 

Average 

range  error  (In.) 

Mo.  I.  6 runs  each 

0.4 

1.3 

1.4 

tk).  2.  6 runs  each 

0.5 

0.8 

1.1 

Mo.  3,  6 runs  each 

0.9 

0.5 

1.0 

Total  of  18  runs 

0.6 

0.9 

1.2 

by  aora  than  a factor  of  chraa.  Mota  also  that  thara  la  a factor  of  two  varlatloti 
batwaan  oparators*  parfonanca  vlthln  aacn  coliam  of  Table  4 related  to  the  use 
of  graphic /owaric  and  only  "graan  lasg)"  displays  • vh:51a  the  coltan  related  to 
test  runs  without  sensor  displays  does  not  show  chat  such  variation  bacvaan 
operators. 

It  Is  interesting  to  coopara  the  dynaalc  and  static  tests.  In  general,  the 
precision  positioning  perforBance  in  the  static  tests  Is  better  by  a factor  cf 
six  as  coBpared  to  the  positioning  performance  in  the  dynamic  tests.  Obviously, 
the  time  pressure  and  tracking  demand  in  the  dynamic  capture  tasks  have  a great 
Impact  on  precision  positioning  performance. 

The  individual  operator  comments  can  be  suamarlzed  as  follows: 

(1)  In  general,  the  sensor  displays  are  useful  and  helpful. 

(2)  The  pitch  and  yaw  error  bars  should  be  colored  different  from  the 
range  error  bars  on  the  graphic  display. 

(3)  In  the  dynamic  testa,  the  dominant  help  came  from  a peripheral  per* 
ceptlon  of  the  graphic  error  bars  and  "green  lamp."  The  maerlc 
display  could  not  be  used  effectively  during  the  dynamic  capture  tasks. 
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(4)  In  chn  scntic  t»sts«  the  nuMrlc  display  provsd  to  bs  useful  and 
provided  an  extrareassurance  over  the  ^aphic  display. 

(5)  The  **«ulti-piece"  and  *'eulti-area”  display  organiaacion  can  be 
counterproductive  when  there  are  tlM  constraints.  An  Integrated  dis- 
play organization  should  be  preferred » e.g. » within  the  frana  of  the 
TV  nonitor. 

(5)  A control  strategy  is  needed  to  effectively  utilize  the  error 
infomation  obtainable  fron  the  displays. 

(7)  Often,  the  controllability  cf  the  aanipulator  did  not  allow  to  cor- 
rect for  errors  shown  on  the  displays. 

5.  COICLUSIONS 

The  tests  dcaonstrated  the  utility  of  the  end  effector  proxlnity  sensor 
and  display  systea  in  facilitating  accurate  range  positioning  and  in  reducing 
alignment  errors  during  grapple  of  e static  payload.  The  advantages  of  a siaple 
"go /no-go"  signal  ("green  leap")  or  a aore  qualitative  "graphic"  display  during 
dynaaic  capture  were  underscored.  The  test  also  deaonstrated  the  iaportance  of 
learning  curve  considerations,  as  well  as  the  eaphasls  of  operator  control 
strategies  In  using  and  integrating  available  infomation  within  reasonable  work- 
load ranges.  The  tests  also  deaonstrated  the  need  for  developing  aore  integrated  * 
displays,  such  that  the  operator  can  achieve  a better  visual  concentration.  The 
developaenc  of  integrated  displays  for  qualitatively  different  and  aultidlasn 
sional  Inforaaclon  raises  interesting  challenges  as  discussed  in  (8af.  2). 
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APPENDIX 

Trans foreat ion  of  Error  Variables 

AaK>ng  the  three  "success"  algoritbns  iaplewented  for  the  previous  tests,  the 
"conic"  algoritlsi  proved  to  be  the  aost  useful  one.  Therefore,  only  the  "conic" 
success  algoritha  has  been  used  for  the  1980  tests  in  both  variations:  for  all 

four  sensors  and  for  any  three  out  of  the  four  sensors.  For  easy  reference,  the 
algorltte  Is  repeated  here  using  the  synbo}s  explained  below. 
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Squarc-SysBitrlc  Coaflgoracioa  of  Four  Froxialty  S«nsor  on 
JSC  Fou. "Clav  End  Cf factor 


S,:  SENSOR 

0,:  DISTANa  TO  TARGET 
MEASURED  lY  SENSOR  S, 


HeMuraMUts  and  Trapaxold  Fomula: 


C,  in. 


1.0 

0.5 

0 


C* 


H 


A 


I 

H 


B 


C IS  A MEASURE  FOR  PITCH  AND  YAW  ERRORS;  C - f(h) 


”a'  ”b'  ”c' 

(AND  IMPLICITLY  ALSO  C*) 
ARE  PRESET  CONSTANTS 


f(H)  IS  GIVEN  BY  THE 
TRAPEZOID  FORMULA 
SHOWN  ABOVE 
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The  «ad  ttf factor  rang*  ralatlva  to  tho  grappla  flxturo  is  roforoncod  to 
th«  cantor  of  tho  and  af factor  which  Is  also  tha  cantar  of  tha  and  af factor 
coordinata  fraaa.  Tharafora*  tha  ranga  (H)  computations  daflnad  balow  and 
appllad  In  tha  previous  casts  ara  invariant  to  tha  coordinata  fraaa  rotations: 

H - 1/2  (D^  + D^)  or  H - 1/2  (D^  + D^)  (1) 

Altamatively,  H ■ 1/4  (Dj^  +*  + D^)  (2) 

Tha  trapezoid  fonsula  and  tha  quadratic  condition  (conic  axprassion)  ara 
also  invariant  to  tha  coordinata  frame  rotations.  Tharafora,  tha  quadratic 
condition  (Eq.  3)  can  ba  used  without  transformation  to  drive  the  success 
display: 

(Dj^  - Dj)^  -t-  (D^  - S L - (3) 

Consequently,  the  "conic**  success  algorithm  can  ba  stated  in  a form  identical 
to  the  one  iMplamantad  for  the  previous  Casta: 


WHERE  H - 1/2  (D|  + 0^) 

1/5  (O2  ♦ D^) 

0 (D^  -D3)^>(0j-0^)^SL 

WHERE  L-C^«  [f(H)j^ 

IF  RCTH  CONDITIONS  ARE  TRUE 
1MN  LIGHT/RUZZER  ARE  ON, 
OTHERWISE  OFF 


"Trua"  (or  "light /buzzer  on")  means  that  tha  existing  combination  of  depth, 
pitch  and  yaw  errors  will  allow  a successful  grasp. 

For  tha  "three  out  of  tha  four  sensors'*  variation  of  tha  conic  algorithm 
(that  is,  %rhan  any  one  of  tha  four  sensor  signals  is  missing),  tha  computation 
of  tha  missing  maasuramant  from  tha  existing  three  sensor  signals  is  iden- 
tical to  tha  one  iatp lamented  for  thv^  previous  tests. 

Tha  display  of  pitch  and  yaw  arrers  rafarancad  to  tha  and  effector  pitch 
and  yaw  control  axes  requires  to  transform  the  dif fart  need  sensor  data, 

(Di -D3)  and  • ^^om  tha  sensor  rafa'^anca  frame  f o tha  and  effector 

rafaranca  frame.  Tha  four  transformations  specified  • ubaaquantly  will  corre- 
spond to  four  possible  rotational  mountings  of  tha  an  . effector  to  tha  %rrist, 
and  will  also  allow  to  select  pitch  and  yaw  trror  pol.  rlty  in  tha  fixed 
graphics  display  format. 
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Aa  a CDnvanianc  initial  rafaraoca.  wa  daf!aa  pitch  and  yav  arror 
polarltiaa  aaaaurad  in  tha  sanaor  frana  and  ahovn  in  the  graphic  display 
frsM  (Figs*  1»  2)  as  follovs: 


'’b  - °31  ■ S 


D,  - D,  A D,,  - E 
*4  2 42  V 


(5) 

(6) 


If  the  pitch  and  yaw  control  axes  were  identical  with  the  sensor  reference 
axes,  the  definitions  given  by  Eqs.  5 and  6 would  correspond  to  the  case  when 
the  error  bars  in  the  display  frame  are  changing  length  in  the  direction  of 
the  hand  controller  displacement. 

The  relation  between  sensor  and  end  effector  reference  axes  is  shown  in 
Fig,  2.  This  figure  shows  the  view  looking  from  the  wrist  towards  the  and 
effector.  Note  that  A,  B and  yellow  strip  are  existing  marks  on  the  claws. 
Note  also  that  the  end  effector  control  axes,  AA  ^nd  BB,  are  along  the  claws. 


The  basic  transformation  of  pitch  and  yaw  error  vectors  from  the 

and  S.S,  axes  to  the  AA  and  BB  axes  is  as  follows: 

2 4 


(7) 


(8) 


y 


■Ojl  * 


(9) 


Note  that  and  are  in  the  graphic  display  reference  frame. 

Suppose  that  the  end  effector  (together  with  the  sensors)  is  rotated  by 
90  deg.  ccw.  when  mounted  to  the  wrist,  without  changing  the  physical  direc- 
tion of  pitch  and  yaw  axes  as  defined  in  Che  graphic  display  frame  (Fig.  1). 
This  requires  the  following  transformation: 


(10) 
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Hftnctt,  for  90  deg.  rotaclon  w«  have: 


- E® 

p y 


« (D 


31 


(U) 


eJ  - <»ji  - 


(12) 


Note  again  chat  and  are  in  che  graphic  display  reference  fraae. 

If  ^he  end  effector  (together  vith  the  sensors)  is  rotated  by  180  deg. 
ccw.  when  mounted  to  the  wrist,  and  the  physical  direction  of  pitch  and  yaw 
axes  are  Icepc  fixed  as  shown  in  che  graphic  display  frame,  then  we  have  to 
perfom  Che  following  transformation: 


(13) 


(14) 

(15) 


270  deg.  rotation,  having  the  same  conditions  as  for  the  90  degree  or 
180  degree  rotations,  will  require  the  following  transformation: 


(16) 


Hence,  for  270  deg.  rotation  we  have: 

*3  ,0 

E - -E  ■ -j 


- E^  • 

y p 


(I>31  ^ D„) 


- °42> 


(17) 

(18) 


2 2 3 3 

Note  that  E , £ , E , and  E are  in  che  graphic  display  reference  frame. 

p yp  y 


618 


. 


Fignrt  Event-Driven  graphic  and  numeric  displays  of  data 
frota  proximity  sensor  system  Integrated  with 
four-claw  end  effector 
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C)  INSIDE  GRASP 
0\1VELOP£  WITH 
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ERRORS  FOP  A 
FINE-CONTROLLED 
GRASP;  GREEN 
LAMP  ON. 
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FUL  GRASP;  GREE^ 
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A HEW  FEEDBACK  INSTRUMENT  FOR  ROBOTS  AND  HAHIPULATORS.  AND  ITS  USE  Ii< 

ROBOT  TEACHING.  SELF  CORRECTION  AND  LEARNING 

By 

0.  S.  Seltzer  and 
0.  E.  Whitney 

The  Charles  Stark  Draper  Laboratory,  Inc. 

Cambridge,  HA  02138 

Abstract 

A new  type  of  tactile  sensing  device,  the  Instrumented  Remote  Cotter 
Compliance  (IRCC)  has  been  developed  for  use  with  Industrial  robots  and 
.iianipulators.  The  IRCC  combines  a passive  mechanical  error-absorbing 
structure  with  instrumentation  capable  of  measuring  position  errors  to  a 
resolution  of  0.1  mm  and  angular  errors  to  a resolution  of  10'^  radians.  The 
IRCC  can  aid  a robot  operator  during  teaching  by  providing  tactile  Information. 
Current  experiments  Indicate  that  this  Information  can  be  utilized  by  either 
displaying  It  to  the  operator,  or  Incorporating  It  directly  In  a computer- 
controlled  feedback  loop.  Future  research  efforts  will  examine  the  use  of 
the  IRCC  for  performance  monitoring  and  correction  for  long  term  effects  such 
as  tool  wear,  part  variation,  and  robot  drift.  The  approach  Is  based  on 
Kalman  Filter  models  of  the  robot,  the  sensor,  and  an  ensemble  of  repeated 
operations  such  as  pai.  transfers  or  assemblies.  Applications  Include 
searching  a visually  occluded  environment,  tracking  drift,  correcting  Initial 
condition  errors  or  detecting  malfunctions. 
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THE  NOSC/MIT  SUBHERSIBLE'HANIPULATOR:  AM  QCPCRIMENT  IN  REtOTE  SUPEIVISORy 
CONTROL  OF  A MICROPROCESSOR  BASED  ROBOT 


Dana  Yoargar 
Thoaas  Sharldan 

Massachusatts  Institute  of  Ylachnology 

This  paper  is  a progress  report  on  the  davelopaant  of  an  es^eriaianral 
free'-swisuning  subnersible  with  a manipulator  arm.  The  system  will  function 
in  the  undersea  environment  while  being  controlled  remotely  in  a superviscry 
node  by  a human  operator.  The  electrically  powered  ana  is  controlled  by  the 
htman  operator  with  the  aid  of  microcomputers  both  on  the  submersible  and 
on  the  surface. 

Developnent  will  begin  with  a manual  control  system  and  a tether  for 
communication  to  and  from  the  vehicle.  After  supervisory  concepts  such 
as  preprogrammed  tasks,  motion  coepensation,  and  active  accomodation  have 
been  implemented,  the  vehicle  will  be  made  free  swimming.  Oomsiutication 
will  then  be  accooplished  through  an  acoustic  data  link. 

Due  to  the  limited  ban^idth  and  delays  inposed  by  the  acoustic  data 
link,  continuous  manual  control  via  the  human  operator  is  not  possible. 
Theretore,  the  menipolator  mst  be  able  to  couplets  tasks  with  only 
high  level  uofmaends  from  the  surface.  Vehicle  motion,  unexpected  collisions, 
as  well  as  subctantial  position  errors  must  be  dealt  with  by  the  relatively 
modest  microcomputer.  The  microcooputer  on  the  surface  will  be  used  to 
provide  the  operator  with  conputer  aided  dir plays  to  further  reduce  the 
effects  of  the  acoustic  link* 
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ANALYSIS  OF  DRIVER  PERFORMANCE  UNDER  REDUCED  VISIBILITY 
Wolf-Oi«t<tr  Ka«ppl«r 

ForschungiinsHtut  fu«r  Anthropotvchnik  (FAT) 

. D-5307  Wachtberg,  F.R.  Germany 


ABSTRACT 

Mathematical  models  describing  vehicle  dynamics  as  well  as  human  behavior  may  be 
useful  in  evoluoting  driver  performano  and  in  establishing  design  criteria  for  vehicles 
more  compatible  with  man.  In  1977,  a two*level  model  of  driver  steering  behavior 
was  developed,  but  its  porometea  were  identified  for  clear  visibility  conditions  only, 
Smce  driver  performance  degrades  under  conditions  of  reduced  visibility,  e,g,  fog, 
the  two-level  model  should  be  investigated  to  determine  its  applioobility  to  such 
conditions. 

The  data  analysis  of  a recently  performed  driving  simulation  experiment  showed  that 
the  model  still  performed  reasonably  well  under  fog  conditions,  although  there  was 
a degradation  in  its  predictive  capacity  during  fog.  Some  odditional  porometen 
affecting  anticipation  and  log  time  may  improve  the  model's  performonoe  for  reduced 
visibility  conditions. 


1,  INTRODUCTION  AND  TWO-LEVEL  MODEL 

Mathematical  models  moy  be  useful  in  evaluating  driver  performance  and  in  eshib- 
lishing  design  criteria  for  vehicles  more  compatible  with  man.  The  state  of  the  srt 
of  mathematical  description  of  car  dynamics  is  rather  high.  However,  there  is  sti!l 
o lack  of  information  about  the  dynamic  behovior  of  car  drivers, 

BoMd  on  the  idea  that  human  behavior  in  loterol  vehicle  control  can  be  described 
in  terms  of  a multi-level  control  task,  Donges  [1]  has  developed  a hvo-ievel  model 
of  driver  steering  behavior.  The  model  is  split  into  anticipatory  and  compensatory 
task  levels  (Fig,  1)  which  are  working  in  parallel. 

At  the  onticipatory  level,  the  driver  is  presented  with  an  outside  forward  view  of  the 
required  path  curvature  which  serves  os  the  forcing  function,  Psrcetving  the  fixture 
course  of  the  rood,  he  is  able  to  reoct  v/ith  a steering  ongle  in  advance  to  turns 

and  obstacles. 

At  the  compensatory  level,  the  driver  compares  octuol  and  required  paths  by  observing, 
e.g.,  heading  ongle  error  f or>d  lateral  ovviotion  y of  the  vehicle.  From  this 
information,  a compensatory  Steering  angle  **  deA^ed  to  correct  the  course  of  the 
car. 
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o)  when  cleor 


F fhis  mode]  in  genera  I h able  fo  predict 
driving  simuloHcn  experiment  K<b  been 


To  examine  thii  suppotiHon  and  fo  find  out 
the  degraded  oerformancc  reoionabl)^  well, 
set  up  and  performed  "7"  . 


2,  DRIVING  SIMULATOR  AND  EXPERIMENTAL  PROCEDURE 


In  the  experimen',  vllibillty  cortdition,  clror 

and  33m  respect! ^/ely^  wf.»j  the  independent  vartaple 
eit  Here  included  the  meojures  : 


velocity 
steering  angle 
heading  ongle  error 
loreral  deviotion 


and  the  model  parameters  for  the 


ricipatory  ond  cpmpensa  ry 

time  delay 
heoding  gcin 
deviation  gain 


anticjpcMon  ^ 

log  ftme 
steering  gain 


he  cxperimrU.  ^ey  were  instructed  to 
trmit,  ^.e  driving  task  consisted  of  s,x  lops 
g teiaions  of  2C  minutes  each  un^er  dea^ 
ervds  of  one  day. 
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3.  RESULTS  AND  DISCUSSION 

on«  might  «xp«ct,  m«<in  lap  speods  for  oach  parson  and  for  tha  group  wart  lowar 
fog  conditions  with  17m  (matars  par  sacond)  than  whan  door  which  was 
n • s ^ (Fig.  4), 


V t MR  ipMtf  0m  l«p 
• t ROfMl 

II  I Mtllw 


Fig.  4 : Moon  lap  spoadi  for  diffdrant  subjacts  and  visibility  conditions 


V : rntrn  90m4  pm  kip 

OBvIrbIrr  Rt  ipRRp 

r : crttrIrtIrr  «RRFn<lRRi 


Fig.  5 : Spoad  variobility  as  a function  of  spood 

o)  whan  door  b)  during  fog 
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V\  addition,  lop  ipoodi  wor«  !•»  voriobla  under  the  fog  condition  with  a standard 
^.aviation  of  1*3  comporod  with  2.1  For  th«  door  condition  (seo  Fig.  5),  probably 
du€  to  the  more  rostrictod  spoad  range  available  to  the  subjects. 


Also,  during  fog  conditions  driving  behovtor  is  more  .jnservative  []3]  leading  subjects 
to  refrain  from  ?ncreosing  their  speeds  between  curves  (see  also  FG  in  Fig.  8a). 


In  both  experimento'  conditions,  lone  deviations  increosed  with  giving  speed  and  the 
absolute  values  of  lane  deviations  were  approximately  the  same  below  18m  »s  .Above 
this  speed,  absolute  lane  deviations  increased  more  unde,  the  fog  condition  (Fig.  6). 


•) 


••  • 
ff 

. V 

•v;-* 

■ir is 


» : mmm  t$m4  pm 

a : l«Ml 

Fig.  6 : Lane  deviation  as  a function  of  speed 

a)  when  clear  b)  during  fog 

The  test  course  cunsists  of  24  segments  of  'U)nstant  curvature.  A step  in  rood  curvature 
occurs  where  two  of  these  segments  join  together.  When  clear,  this  is  seen  long  before 
it  is  reached  by  the  driver  so  that  he  is  able  to  react  in  advance.  T^ie  histories 
(means  and  stondard  deviations  averoged  over  30  individual  time  histories)  of  the  de* 
pendent  voriobles  under  clear  ond  fog  conditions  arn  shown  in  Fig*Arc  7 for  a left 
hand  turn. 

The  speed  variation  is  quite  small  though  six  subjects  ere  involved  (|Me  Fig.  7c). 

When  it  is  clear,  the  steering  reaction  shown  in  the  left  part  of  Fig.  76  is  starting 
of  a certain  time  prior  to  the  step  chonge.  The  steering  angle  shovxs  o tagged 
tronsient  with  a small  overshoot.  The  succesr  of  this  reaction  is  illustrated  by  the  fact 
that  the  lateral  deviation  (Fig.  7F)  tends  to  be  evenly  distributed  arour^  the  center  * 
lir>e  with  o bias  in  the  direction  of  the  curve,  i.e.,  more  left  de /lotions  in  left  hand 
turns. 

In  the  right  port  Fig.  7,  the  time  histories  under  fog  concitions  are  shown.  The 
steering  reoction  (Fig.  7d)  starts  late  in  response  to  /he  step  change  lesulting  in  o 
lorpo  lone  deviation  to  the  right  of  the  center-line  :n  o left  turn  (Fig.  7f).  This 
graph  oljo  shows  * toep  transient  with  a lorge  overihoot.  Clearly,  the  reduced 
informotion  in  co;  dition  does  not  permit  the  driver  to  perform  prcpei^y. 
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To  givo  on  impromion  of  tho  officimcx  of  tho  fwo^tovoi  modol,  combinod  flmm  histo* 
rios  of  ono  drtvor,  tho  drivor  modoi  and  ih  Goinpononfi  ovo  sho^^n  in  Fig.  8 for  on 
orbflranly  choMn  oxonpto  for  coch  of  fhm  visibiitty  oonditiont. 

CUEA8  FOG 


Fig.  8 : Timo  htstorios  of  stooring  angles  (LW)  of  ono  driver, 
driver  model  ond  driver  model  components 


Required  path  curvature  (VCS)  end  vehicle  speed  (FG)  ore  shown  in  Fig.  8o  to  dtscribe 
the  experimental  situotion.  A*  one  con  see  in  Fig.  8b,  the  two-level  model  predicts 
dtiver  steering  reaction  reoscnobly  well  in  clear  and  fog  oonditiom  olthough  better  so 
urtder  clear  conditions  which  follows  from  the  detailed  data  onalysis.  It  out  that 

for  ^oth  conditions  heoding  ongie  Inputs  ocoount  for  the  largest  port  (see  Fig.  8c)  of 
the  compensatory  level  response  shown  in  Figure  8c. 

In  fog,  the  model  accounts  for  o smolier  portion  of  the  steering  reoction  at  the  ontici- 
potory  i#'«ei.  One  recsor.  is  that  the  chosen  first  order  log  is  not  able  to  reproduot  the 
overshoot  which  occured  in  the  fo^  see  Fig.  8b).  Besides,  the  transient  of  the  moiiel 
is  no*  as  steep  os  the  experimentol  doto  show  (Fig.  8b  and  c).  This  is  because  the  onti* 
cipotion  time  T.  could  not  olwoys  be  identified  correctly  by  the  leost  meon  square  method 
used  here.  Oiring  fog,  the  driver  mokes  steerir^g  movements  to  the  left  or  right,  not 
reoily  knowing  when  o turn  will  oppeor  ond  whot  kind  of  turn  this  wil  be.  These  evriy 
steering  movements  moy  be  interpreted  by  the  model  os  eorly  reoctions  to  the  curve. 
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SoM  modifM  mMn  t^uar>  iwfKoA  will  hm  •voluolsd  in  thm  fuhira  lo  cImt 
Qwa)r  this  dnfnct.  It  oho  oppoort  thot  tho  two«4ovot  modol  oould«  porhopt,  bo 
improvod  for  limitod  visibility  conditions  by  induding  odditionol  poromotois  offsctinp 
onficipotion  and  log  time. 
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